00000001:02000400:3.0F:1787579759.154185:0:2969:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg236-server.virtnet: executing set_hostid 00000001:02000400:2.0F:1787579782.000278:0:3190:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg236-server.virtnet: executing load_modules_local 00000001:01000000:3.0:1787579784.286260:0:3252:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 422 MB/s 00000001:01000000:2.0:1787579784.539942:0:3252:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 452 MB/s 00000001:01000000:2.0:1787579784.789771:0:3252:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 5899 MB/s 00000020:02000000:2.0:1787579785.837003:0:3283:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_80_g3abb7b2 00000400:02000000:3.0:1787579787.319991:0:3298:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.202.136@tcp [8/256/0/180] 00008000:02000000:1.0F:1787579791.775248:0:3448:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0F:1787579850.949665:0:5252:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg236-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1787579864.385895:0:5834:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787579864.385901:0:5834:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1787579864.386114:0:5834:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000005ad218bb 00000080:02000400:0.0:1787579864.386126:0:5834:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:0.0:1787579864.390692:0:5834:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:0.0:1787579864.390706:0:5834:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1787579864.391870:0:5834:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000007b81340f) 00000020:00000080:2.0:1787579864.391904:0:5834:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1787579864.439586:0:5834:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1787579864.441614:0:5834:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1787579864.541640:0:5834:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1787579864.541683:0:5834:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787579864.541704:0:5834:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1787579864.541769:0:5834:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787579864.541795:0:5834:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1787579864.542322:0:5834:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1787579864.542331:0:5834:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787579864.542341:0:5834:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc86deac2083373cf 00000020:01000004:2.0:1787579864.542349:0:5834:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1787579864.542354:0:5834:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1787579864.542358:0:5834:0:(tgt_mount.c:101:server_register_mount()) register mount 000000005ad218bb from MGS 00000020:01000004:2.0:1787579864.542363:0:5834:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1787579864.542373:0:5834:0:(genops.c:413:class_newdev()) Allocate new device MGS (0000000028a2c8b2) 00000020:00000080:2.0:1787579864.542408:0:5834:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1787579864.542482:0:5834:0:(tgt_mount.c:153:server_get_mount()) get mount 000000005ad218bb from MGS, refs=2 00080000:01000000:2.0:1787579864.542488:0:5834:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787579864.542494:0:5834:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc86deac2083373dd 00000100:00100000:2.0:1787579864.542584:0:5834:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1787579864.542730:0:5834:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1787579864.542736:0:5834:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1787579864.548614:0:5834:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1787579864.548627:0:5834:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1787579864.549585:0:5834:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787579864.550693:0:5834:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1787579864.550706:0:5834:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1787579864.552591:0:5834:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1787579864.552603:0:5834:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1787579864.560947:0:5834:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1787579864.560961:0:5834:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1787579864.563561:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579864.563566:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579864.563568:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579864.563924:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579864.563936:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579864.563938:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787579864.564839:0:5834:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1787579864.582181:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1787579864.827300:0:5834:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 1564 MB/s 00000001:01000000:3.0:1787579865.089632:0:5834:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 1787 MB/s 00000001:01000000:1.0:1787579865.340602:0:5834:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 290 MB/s 00010000:00010000:3.0:1787579865.588592:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:0.0:1787579865.590629:0:5834:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 259 MB/s 00080000:10000000:2.0:1787579865.632845:0:5834:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:0.0:1787579865.685273:0:5834:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1787579865.685290:0:5834:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1787579865.685292:0:5834:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1787579865.700425:0:5844:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1787579865.700817:0:5834:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1787579865.700876:0:5834:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1787579865.701142:0:5834:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1787579865.702842:0:5834:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1787579865.705186:0:5834:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787579865.705363:0:5834:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1787579865.705369:0:5834:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1787579865.712140:0:5834:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1787579865.712165:0:5834:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1787579865.713759:0:5834:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1787579865.713772:0:5834:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1787579865.719051:0:5834:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1787579865.719082:0:5834:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.136@tcp' 00000020:01000004:0.0:1787579865.719084:0:5834:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1787579865.719126:0:5834:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.136@tcp (typ=mgc) 00000020:00000080:0.0:1787579865.719152:0:5834:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.136@tcp (000000008f51e77e) 00000020:00000080:0.0:1787579865.719171:0:5834:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1787579865.719289:0:5834:0:(ldlm_lib.c:102:import_set_conn()) imp 000000004d086a9f@MGC192.168.202.136@tcp: add connection 192.168.202.136@tcp at head 00010000:00010000:0.0:1787579865.719457:0:5834:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.136@tcp-0 is initialized 00000040:01000000:0.0:1787579865.719462:0:5834:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.136@tcp ctxt 1 is initialized 00000100:00080000:2.0:1787579865.722061:0:5849:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1787579865.724529:0:5850:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1787579865.724658:0:5834:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.136@tcp (uuid 4373e6ff-5428-48a2-95c7-e4d05b6f69ed) 00000020:00000080:1.0:1787579865.724705:0:5834:0:(genops.c:1385:class_connect()) connect: client 4373e6ff-5428-48a2-95c7-e4d05b6f69ed, cookie 0xc86deac2083373eb 00000100:00080000:1.0:1787579865.724724:0:5834:0:(import.c:510:import_select_connection()) MGC192.168.202.136@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787579865.724731:0:5834:0:(import.c:624:import_select_connection()) MGC192.168.202.136@tcp: import 000000004d086a9f using connection 192.168.202.136@tcp/0@lo 00000100:00100000:1.0:1787579865.724810:0:5834:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000553dd724 x1874413262733440/t0(0) o250->MGC192.168.202.136@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787579865.724842:0:5834:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 4373e6ff-5428-48a2-95c7-e4d05b6f69ed->MGS 00000020:01000004:1.0:1787579865.724868:0:5834:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1787579865.724873:0:5834:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000100:00100000:0.0:1787579865.725129:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000553dd724 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3313:1874413262733440:0@lo:250: 00000100:00100000:0.0:1787579865.725244:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579865.725341:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262733440 00000100:00100000:0.0:1787579865.725349:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262733440 00000100:00100000:0.0:1787579865.725399:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787579865.725413:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b329e1a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3313:x1874413262733440:12345-0@lo:250: 00010000:00080000:0.0:1787579865.725436:0:5845:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 4373e6ff-5428-48a2-95c7-e4d05b6f69ed@0@lo t0 exp 0000000000000000 cur 213 last 0 00000020:00000080:0.0:1787579865.725458:0:5845:0:(genops.c:1385:class_connect()) connect: client 4373e6ff-5428-48a2-95c7-e4d05b6f69ed, cookie 0xc86deac2083373f2 00000100:00080000:0.0:1787579865.725597:0:5845:0:(import.c:65:import_set_state_nolock()) 000000008711dc54 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787579865.725650:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b329e1a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+5:3313:x1874413262733440:12345-0@lo:250: Request processed in 237us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579865.725659:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000020:00000080:1.0:1787579865.725843:0:5834:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000d541638b) 00000020:00000080:1.0:1787579865.725857:0:5834:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1787579865.726815:0:3313:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.202.136@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1787579865.726826:0:3313:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.136@tcp: connect to target with instance 0 00000100:00080000:0.0:1787579865.726834:0:3313:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.136@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1787579865.726838:0:3313:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1787579865.726841:0:3313:0:(import.c:65:import_set_state_nolock()) 000000004d086a9f MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1787579865.726843:0:3313:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1787579865.726856:0:3313:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1787579865.726862:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000553dd724 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3313:1874413262733440:0@lo:250: 00000100:00100000:0.0:1787579865.755145:0:5834:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787579865.755430:0:5834:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1787579865.755438:0:5834:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1787579865.762279:0:5834:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1787579865.762301:0:5834:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1787579865.762942:0:5834:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1787579865.762949:0:5834:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1787579865.763853:0:5834:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787579865.764036:0:5834:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1787579865.764041:0:5834:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1787579865.770057:0:5834:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1787579865.770070:0:5834:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1787579865.879553:0:5834:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787579865.879820:0:5834:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1787579865.879828:0:5834:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1787579865.884040:0:5834:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1787579865.884052:0:5834:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1787579865.886967:0:5834:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787579865.887518:0:5834:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787579865.887524:0:5834:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1787579865.894747:0:5834:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787579865.894771:0:5834:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1787579865.896017:0:5834:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787579865.896375:0:5834:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787579865.896437:0:5834:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1787579865.911964:0:5834:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787579865.912398:0:5834:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1787579865.916481:0:5834:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787579865.916893:0:5834:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787579865.916899:0:5834:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1787579865.922539:0:5834:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787579865.922559:0:5834:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1787579866.001984:0:5834:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787579866.002215:0:5834:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787579866.002233:0:5834:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1787579866.006464:0:5834:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787579866.006478:0:5834:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1787579866.022463:0:5834:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787579866.022711:0:5834:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1787579866.024594:0:5834:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1787579866.024619:0:5834:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1787579866.024625:0:5834:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.136@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1787579866.024748:0:5834:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.136@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787579866.024829:0:5834:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.136@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1787579866.024833:0:5834:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787579866.024835:0:5834:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787579866.024836:0:5834:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787579866.024837:0:5834:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787579866.024839:0:5834:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787579866.024839:0:5834:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787579866.024841:0:5834:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787579866.024842:0:5834:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787579866.024844:0:5834:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787579866.024845:0:5834:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787579866.024847:0:5834:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787579866.024849:0:5834:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787579866.024856:0:5834:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1787579866.024859:0:5834:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787579866.024860:0:5834:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787579866.024861:0:5834:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787579866.024862:0:5834:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787579866.024862:0:5834:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787579866.024863:0:5834:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787579866.024864:0:5834:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787579866.024874:0:5834:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787579866.024875:0:5834:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787579866.024876:0:5834:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787579866.024877:0:5834:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787579866.024887:0:5834:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787579866.024931:0:5834:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787579866.024951:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000013b8ed6d pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5834:1874413262733568:0@lo:253: 00000100:00100000:2.0:1787579866.025041:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579866.025092:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ecc2e27f going to sleep for 11 seconds 00000100:00100000:1.0:1787579866.025458:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262733568 00000100:00100000:1.0:1787579866.025466:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262733568 00000100:00100000:1.0:1787579866.025504:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787579866.025514:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000de0da947 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+5:5834:x1874413262733568:12345-0@lo:253: 20000000:01000000:1.0:1787579866.028110:0:5848:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787579866.028116:0:5848:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1787579866.032463:0:5868:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1787579866.032578:0:5848:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1787579866.033646:0:5848:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787579866.039615:0:5869:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1787579866.039924:0:5848:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787579866.039928:0:5848:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1787579866.039934:0:5848:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1787579866.039937:0:5848:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1787579866.039951:0:5848:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1787579866.040186:0:5848:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787579866.040464:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1787579866.040478:0:5848:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787579866.040529:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1787579866.041004:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1787579866.041038:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1787579866.041122:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1787579866.041131:0:5848:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1787579866.041206:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1787579866.041216:0:5848:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1787579866.041249:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1787579866.041257:0:5848:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1787579866.041286:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1787579866.041335:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1787579866.041367:0:5848:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1787579866.041372:0:5848:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1787579866.041422:0:5848:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787579866.042101:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1787579866.042116:0:5848:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1787579866.042169:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1787579866.042206:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1787579866.042262:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1787579866.042276:0:5848:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1787579866.042350:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1787579866.042358:0:5848:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1787579866.042433:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1787579866.042471:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1787579866.042502:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1787579866.042513:0:5848:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1787579866.043072:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1787579866.043084:0:5848:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1787579866.043115:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1787579866.043150:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1787579866.043319:0:5848:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1787579866.043373:0:5848:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1787579866.043884:0:5848:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1787579866.044476:0:5870:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1787579866.044772:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1787579866.044806:0:5848:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.136@tcp for mdt 20000000:01000000:0.0:1787579866.044808:0:5848:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.136@tcp (null) (null) (null) 00000040:00080000:0.0:1787579866.044855:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1787579866.044863:0:5848:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1787579866.044897:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1787579866.044912:0:5848:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.202.136@tcp (null) (null) 00000040:00080000:0.0:1787579866.044977:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1787579866.044989:0:5848:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1787579866.045022:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1787579866.045054:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1787579866.045115:0:5848:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1787579866.045118:0:5848:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1787579866.045123:0:5848:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1787579866.045130:0:5848:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1787579866.045924:0:5871:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:0.0:1787579866.046093:0:5848:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1787579866.063238:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1787579866.063295:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:2.0:1787579866.063372:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:2.0:1787579866.063426:0:5848:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1787579866.063429:0:5848:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1787579866.063433:0:5848:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1787579866.063446:0:5848:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787579866.063449:0:5848:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1787579866.063480:0:5848:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787579866.063483:0:5848:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787579866.070761:0:5872:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:2.0:1787579866.080120:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:2.0:1787579866.080204:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:2.0:1787579866.080275:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 20000000:01000000:2.0:1787579866.080288:0:5848:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787579866.080291:0:5848:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787579866.082060:0:5873:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1787579866.082788:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1787579866.083684:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1787579866.083970:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:2.0:1787579866.083993:0:5848:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787579866.084009:0:5848:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:2.0:1787579866.084017:0:5848:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787579866.084038:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000afaff75e/0xc86deac208337400 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579866.084054:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000afaff75e/0xc86deac208337400 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579866.084064:0:5848:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000afaff75e/0xc86deac208337400 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579866.084070:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000afaff75e/0xc86deac208337400 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579866.084076:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000afaff75e/0xc86deac208337400 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579866.084081:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000afaff75e/0xc86deac208337400 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579866.084086:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000afaff75e already unused, calling callback (000000001d5ed376) 00010000:00010000:2.0:1787579866.084090:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000afaff75e/0xc86deac208337400 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579866.084096:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000afaff75e/0xc86deac208337400 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579866.084108:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000afaff75e/0xc86deac208337400 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579866.084114:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000afaff75e/0xc86deac208337400 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579866.084127:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000afaff75e/0xc86deac208337400 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787579866.084147:0:5848:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1787579866.595897:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000de0da947 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+5:5834:x1874413262733568:12345-0@lo:253: Request processed in 570375us (570846us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579866.595923:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787579866.596038:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000013b8ed6d pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5834:1874413262733568:0@lo:253: 10000000:01000000:2.0:1787579866.596053:0:5834:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787579866.596056:0:5834:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787579866.596058:0:5834:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787579866.596059:0:5834:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787579866.596061:0:5834:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1787579866.596062:0:5834:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787579866.596063:0:5834:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787579866.596064:0:5834:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787579866.596065:0:5834:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787579866.596067:0:5834:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1787579866.596068:0:5834:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787579866.596069:0:5834:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787579866.596087:0:5834:0:(tgt_mount.c:101:server_register_mount()) register mount 000000005ad218bb from lustre-MDT0000 10000000:01000000:2.0:1787579866.596131:0:5834:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1787579866.596134:0:5834:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787579866.596138:0:5834:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8fae503119b8 10000000:01000000:2.0:1787579866.596143:0:5834:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787579866.596152:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8fae503119b8 from 1 10000000:01000000:2.0:1787579866.596155:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787579866.596193:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: 00000000afaff75e/0xc86deac208337407 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579866.596203:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: 00000000afaff75e/0xc86deac208337407 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579866.596211:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: 00000000afaff75e/0xc86deac208337407 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579866.596247:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000013b8ed6d pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5834:1874413262733696:0@lo:101: 00000100:00100000:2.0:1787579866.596283:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579866.596343:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set 000000002100bdb0 going to sleep for 11 seconds 00000100:00100000:3.0:1787579866.596467:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262733696 00000100:00100000:3.0:1787579866.596474:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262733696 00000100:00100000:3.0:1787579866.596526:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787579866.596534:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000025755dc5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+5:5834:x1874413262733696:12345-0@lo:101: 00010000:00010000:3.0:1787579866.596545:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787579866.596556:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a0f966a5/0xc86deac20833740e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc86deac208337407 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579866.596574:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a0f966a5/0xc86deac20833740e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc86deac208337407 expref: 6 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579866.596592:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a0f966a5/0xc86deac20833740e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac208337407 expref: 6 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579866.596600:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a0f966a5, rc 0) 00000100:00100000:3.0:1787579866.596633:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000025755dc5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+6:5834:x1874413262733696:12345-0@lo:101: Request processed in 101us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579866.596639:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787579866.596715:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000013b8ed6d pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5834:1874413262733696:0@lo:101: 00010000:00010000:0.0:1787579866.596727:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: 00000000afaff75e/0xc86deac208337407 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac20833740e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579866.596734:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: 00000000afaff75e/0xc86deac208337407 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc86deac20833740e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579866.596797:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000db608f72 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5834:1874413262733824:0@lo:501: 00000100:00100000:0.0:1787579866.596823:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579866.596849:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set 000000006882a0ce going to sleep for 11 seconds 00000100:00100000:2.0:1787579866.596909:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262733824 00000100:00100000:2.0:1787579866.596914:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262733824 00000100:00100000:2.0:1787579866.596947:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787579866.596953:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e2326cc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+6:5834:x1874413262733824:12345-0@lo:501: 00000100:00100000:2.0:1787579866.597200:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e2326cc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+6:5834:x1874413262733824:12345-0@lo:501: Request processed in 246us (375us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787579866.597207:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787579866.597472:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000db608f72 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5834:1874413262733824:0@lo:501: 10000000:01000000:0.0:1787579866.597499:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787579866.597524:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: 00000000afaff75e/0xc86deac208337407 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac20833740e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579866.597532:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: 00000000afaff75e/0xc86deac208337407 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac20833740e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787579866.597540:0:5834:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8fae6a238800 10000000:01000000:0.0:1787579866.597544:0:5834:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787579866.597548:0:5834:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8fae6a238800 10000000:01000000:0.0:1787579866.597550:0:5834:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1787579866.597552:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8fae6a238800 from 1 10000000:01000000:0.0:1787579866.597555:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1787579866.597584:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: 00000000d619b7f2/0xc86deac208337415 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579866.597591:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: 00000000d619b7f2/0xc86deac208337415 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579866.597597:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: 00000000d619b7f2/0xc86deac208337415 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579866.597608:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000db608f72 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5834:1874413262733952:0@lo:101: 00000100:00100000:0.0:1787579866.597635:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579866.597663:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set 000000006882a0ce going to sleep for 11 seconds 00000100:00100000:2.0:1787579866.604400:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262733952 00000100:00100000:2.0:1787579866.604419:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262733952 00000100:00100000:2.0:1787579866.604482:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787579866.604492:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e622ecc3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+6:5834:x1874413262733952:12345-0@lo:101: 00010000:00010000:2.0:1787579866.604515:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787579866.604539:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006b56f099/0xc86deac20833741c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc86deac208337415 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579866.604583:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006b56f099/0xc86deac20833741c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc86deac208337415 expref: 7 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579866.604595:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006b56f099/0xc86deac20833741c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac208337415 expref: 7 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579866.604605:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006b56f099, rc 0) 00000100:00100000:2.0:1787579866.604708:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e622ecc3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+7:5834:x1874413262733952:12345-0@lo:101: Request processed in 217us (7072us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579866.604736:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787579866.605282:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000db608f72 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5834:1874413262733952:0@lo:101: 00010000:00010000:0.0:1787579866.605304:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: 00000000d619b7f2/0xc86deac208337415 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac20833741c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579866.605315:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: 00000000d619b7f2/0xc86deac208337415 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc86deac20833741c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787579866.605353:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1787579866.605372:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: 00000000d619b7f2/0xc86deac208337415 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac20833741c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579866.605410:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: 00000000d619b7f2/0xc86deac208337415 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac20833741c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787579866.605420:0:5834:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1787579866.605425:0:5834:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787579866.605431:0:5834:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8fae6a238800 10000000:01000000:0.0:1787579866.605434:0:5834:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1787579866.605438:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1787579866.605441:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787579866.605464:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: 00000000c48310ce/0xc86deac208337423 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579866.605471:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: 00000000c48310ce/0xc86deac208337423 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579866.605479:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: 00000000c48310ce/0xc86deac208337423 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579866.605496:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000db608f72 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5834:1874413262734080:0@lo:101: 00000100:00100000:0.0:1787579866.605535:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579866.605600:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set 000000006882a0ce going to sleep for 11 seconds 00000100:00100000:1.0:1787579866.605833:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262734080 00000100:00100000:1.0:1787579866.605839:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262734080 00000100:00100000:1.0:1787579866.605880:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787579866.605887:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d4c7ee35 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+7:5834:x1874413262734080:12345-0@lo:101: 00010000:00010000:1.0:1787579866.605897:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787579866.605911:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000beb5e8f0/0xc86deac20833742a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc86deac208337423 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579866.605928:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000beb5e8f0/0xc86deac20833742a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc86deac208337423 expref: 8 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579866.605937:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000beb5e8f0/0xc86deac20833742a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac208337423 expref: 8 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579866.605957:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000beb5e8f0, rc 0) 00000100:00100000:1.0:1787579866.606025:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d4c7ee35 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+8:5834:x1874413262734080:12345-0@lo:101: Request processed in 138us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579866.606032:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787579866.607928:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000db608f72 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5834:1874413262734080:0@lo:101: 00010000:00010000:0.0:1787579866.607955:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: 00000000c48310ce/0xc86deac208337423 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac20833742a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579866.607984:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: 00000000c48310ce/0xc86deac208337423 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc86deac20833742a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579866.608059:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000db608f72 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5834:1874413262734208:0@lo:501: 00000100:00100000:0.0:1787579866.608135:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579866.608178:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set 000000006882a0ce going to sleep for 11 seconds 00000100:00100000:3.0:1787579866.608320:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262734208 00000100:00100000:3.0:1787579866.608327:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262734208 00000100:00100000:3.0:1787579866.608374:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787579866.608420:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001e5086aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+8:5834:x1874413262734208:12345-0@lo:501: 00000100:00100000:3.0:1787579866.608687:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001e5086aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+9:5834:x1874413262734208:12345-0@lo:501: Request processed in 306us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579866.608695:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787579866.611240:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000db608f72 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5834:1874413262734208:0@lo:501: 00000100:00100000:0.0:1787579866.611306:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000db608f72 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5834:1874413262734336:0@lo:503: 00000100:00100000:0.0:1787579866.611458:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579866.611498:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set 000000006882a0ce going to sleep for 11 seconds 00000100:00100000:2.0:1787579866.611746:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262734336 00000100:00100000:2.0:1787579866.611754:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262734336 00000100:00100000:2.0:1787579866.611814:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787579866.611822:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fa6aac4b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+9:5834:x1874413262734336:12345-0@lo:503: 00000100:00100000:2.0:1787579866.612011:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fa6aac4b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+9:5834:x1874413262734336:12345-0@lo:503: Request processed in 190us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579866.612018:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787579866.612260:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000db608f72 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5834:1874413262734336:0@lo:503: 00010000:00010000:3.0:1787579866.612733:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787579866.613063:0:5875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000ccd8eb4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5875:1874413262734464:0@lo:502: 00000100:00100000:0.0:1787579866.613116:0:5875:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579866.613154:0:5875:0:(client.c:2715:ptlrpc_set_wait()) set 000000006882a0ce going to sleep for 11 seconds 00000100:00100000:1.0:1787579866.613778:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262734464 00000100:00100000:1.0:1787579866.613794:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262734464 00000100:00100000:1.0:1787579866.613838:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787579866.613845:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000095e7f5f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+9:5875:x1874413262734464:12345-0@lo:502: 00000100:00100000:1.0:1787579866.614052:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000095e7f5f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+9:5875:x1874413262734464:12345-0@lo:502: Request processed in 207us (935us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579866.614060:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787579866.614248:0:5875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000ccd8eb4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5875:1874413262734464:0@lo:502: 00000020:01000000:0.0:1787579866.614283:0:5875:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787579866.614293:0:5875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787579866.614295:0:5875:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787579866.614301:0:5875:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1787579866.614304:0:5875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787579866.614316:0:5875:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000008f33b783) 00000020:00000080:0.0:1787579866.614334:0:5875:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1787579866.614339:0:5875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1787579866.614440:0:5875:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:0.0:1787579866.614446:0:5875:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc86deac208337438 00000020:00000080:0.0:1787579866.614703:0:5875:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1787579866.614707:0:5875:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787579866.614713:0:5875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787579866.614715:0:5875:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787579866.614717:0:5875:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787579866.614720:0:5875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787579866.614721:0:5875:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1787579866.614724:0:5875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787579866.614730:0:5875:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000627735ed) 00000020:00000080:0.0:1787579866.614739:0:5875:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1787579866.614741:0:5875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1787579866.614743:0:5875:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1787579866.614745:0:5875:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1787579866.614751:0:5875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787579866.614805:0:5875:0:(tgt_mount.c:153:server_get_mount()) get mount 000000005ad218bb from lustre-MDT0000, refs=3 00000020:00000080:0.0:1787579866.614817:0:5875:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000008d058f24) 00000020:00000080:0.0:1787579866.614823:0:5875:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1787579866.614895:0:5875:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1787579866.614901:0:5875:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc86deac20833744d 00000020:00000080:0.0:1787579866.614993:0:5875:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1787579866.614999:0:5875:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1787579866.615005:0:5875:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xc86deac208337454 00080000:01000000:0.0:1787579866.615009:0:5875:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:0.0:1787579866.615012:0:5875:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc86deac20833745b 00080000:10000000:0.0:1787579866.617764:0:5875:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:0.0:1787579866.618055:0:5875:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:0.0:1787579866.627374:0:5875:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1787579866.743241:0:5875:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1787579866.745069:0:5875:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1787579866.749145:0:5875:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1787579866.749569:0:5875:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1787579866.826377:0:5875:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000ce68419a) 00000020:00000080:0.0:1787579866.826429:0:5875:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1787579866.826518:0:5875:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:0.0:1787579866.826527:0:5875:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc86deac208337469 00000020:00000080:0.0:1787579866.835408:0:5875:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:0.0:1787579866.848775:0:5875:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:0.0:1787579866.955705:0:5875:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1787579867.024302:0:5875:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1787579867.123870:0:5875:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:1.0:1787579867.239903:0:5875:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:0.0:1787579867.317312:0:5875:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:1.0:1787579867.398243:0:5875:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xc86deac208337470 00000020:00000080:1.0:1787579867.398879:0:5875:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1787579867.398998:0:5875:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787579867.399004:0:5875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787579867.399006:0:5875:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1787579867.399009:0:5875:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787579867.399014:0:5875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787579867.399016:0:5875:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1787579867.399020:0:5875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1787579867.399055:0:5875:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1787579867.399066:0:5875:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787579867.399070:0:5875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787579867.399071:0:5875:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1787579867.399073:0:5875:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787579867.399084:0:5875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787579867.399085:0:5875:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787579867.399088:0:5875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787579867.399090:0:5875:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1787579867.399132:0:5875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000018af4bf1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5875:1874413262734592:0@lo:502: 00000100:00100000:1.0:1787579867.399208:0:5875:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579867.399277:0:5875:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ee90fb3c going to sleep for 11 seconds 00000100:00100000:3.0:1787579867.399344:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262734592 00000100:00100000:3.0:1787579867.399351:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262734592 00000100:00100000:3.0:1787579867.399420:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787579867.399429:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002a29e6c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+9:5875:x1874413262734592:12345-0@lo:502: 00000100:00100000:3.0:1787579867.400084:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002a29e6c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+9:5875:x1874413262734592:12345-0@lo:502: Request processed in 654us (874us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579867.400093:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787579867.400739:0:5875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000018af4bf1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5875:1874413262734592:0@lo:502: 00000020:01000000:2.0:1787579867.400772:0:5875:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787579867.400777:0:5875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787579867.400788:0:5875:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787579867.400792:0:5875:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1787579867.401017:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1787579867.401034:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787579867.401053:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: 00000000c48310ce/0xc86deac208337423 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac20833742a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579867.401064:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: 00000000c48310ce/0xc86deac208337423 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac20833742a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787579867.401071:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8fae6a238800 from 1 10000000:01000000:1.0:1787579867.401074:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787579867.401105:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: 0000000015ab0d76/0xc86deac208337477 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579867.401112:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: 0000000015ab0d76/0xc86deac208337477 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579867.401120:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: 0000000015ab0d76/0xc86deac208337477 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579867.401135:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002a3d239e pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5834:1874413262734720:0@lo:101: 00000100:00100000:1.0:1787579867.401171:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579867.401205:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set 000000009f1bfb63 going to sleep for 11 seconds 00000100:00100000:2.0:1787579867.401259:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262734720 00000100:00100000:2.0:1787579867.401264:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262734720 00000100:00100000:2.0:1787579867.401304:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787579867.401313:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e8380efd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+9:5834:x1874413262734720:12345-0@lo:101: 00010000:00010000:2.0:1787579867.401323:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787579867.401334:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000013bb10a8/0xc86deac20833747e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc86deac208337477 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579867.401353:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000013bb10a8/0xc86deac20833747e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc86deac208337477 expref: 10 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579867.401375:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000013bb10a8/0xc86deac20833747e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac208337477 expref: 10 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579867.401419:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000013bb10a8, rc 0) 00000100:00100000:2.0:1787579867.401451:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e8380efd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+10:5834:x1874413262734720:12345-0@lo:101: Request processed in 140us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579867.401457:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787579867.401547:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002a3d239e pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5834:1874413262734720:0@lo:101: 00010000:00010000:1.0:1787579867.401579:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: 0000000015ab0d76/0xc86deac208337477 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac20833747e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579867.401587:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: 0000000015ab0d76/0xc86deac208337477 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc86deac20833747e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579867.402377:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002a3d239e pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5834:1874413262734848:0@lo:256: 00000100:00100000:1.0:1787579867.405047:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579867.405093:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set 000000009f1bfb63 going to sleep for 11 seconds 00000100:00100000:2.0:1787579867.405304:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262734848 00000100:00100000:2.0:1787579867.405313:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262734848 00000100:00100000:2.0:1787579867.405364:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787579867.405371:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fd3c66f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+10:5834:x1874413262734848:12345-0@lo:256: 20000000:01000000:2.0:1787579867.405403:0:5847:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1787579867.405407:0:5847:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1787579867.405462:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fd3c66f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+10:5834:x1874413262734848:12345-0@lo:256: Request processed in 93us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579867.405467:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787579867.405765:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002a3d239e pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5834:1874413262734848:0@lo:256: 10000000:01000000:1.0:1787579867.408124:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787579867.408202:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: 0000000015ab0d76/0xc86deac208337477 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac20833747e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579867.408215:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: 0000000015ab0d76/0xc86deac208337477 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac20833747e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787579867.408285:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8fae6a238800 from 1 10000000:01000000:2.0:1787579867.408290:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787579867.408335:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: 000000003590f4d0/0xc86deac208337485 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579867.408344:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: 000000003590f4d0/0xc86deac208337485 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579867.408354:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: 000000003590f4d0/0xc86deac208337485 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579867.408376:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fdd7af43 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5834:1874413262734976:0@lo:101: 00000100:00100000:2.0:1787579867.408503:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579867.408539:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set 000000003e36ab1c going to sleep for 11 seconds 00000100:00100000:0.0:1787579867.408842:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262734976 00000100:00100000:0.0:1787579867.408853:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262734976 00000100:00100000:0.0:1787579867.408919:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787579867.408928:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e1b56144 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+10:5834:x1874413262734976:12345-0@lo:101: 00010000:00010000:0.0:1787579867.408941:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787579867.408957:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c1e7d2fc/0xc86deac20833748c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc86deac208337485 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579867.408979:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c1e7d2fc/0xc86deac20833748c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc86deac208337485 expref: 11 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579867.408988:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c1e7d2fc/0xc86deac20833748c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac208337485 expref: 11 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579867.408996:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c1e7d2fc, rc 0) 00000100:00100000:0.0:1787579867.409045:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e1b56144 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+11:5834:x1874413262734976:12345-0@lo:101: Request processed in 118us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579867.409051:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787579867.409198:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fdd7af43 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5834:1874413262734976:0@lo:101: 00010000:00010000:1.0:1787579867.409213:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: 000000003590f4d0/0xc86deac208337485 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac20833748c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579867.409220:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: 000000003590f4d0/0xc86deac208337485 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc86deac20833748c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579867.409274:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002a3d239e pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5834:1874413262735104:0@lo:501: 00000100:00100000:1.0:1787579867.409301:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579867.409325:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set 000000009f1bfb63 going to sleep for 11 seconds 00000100:00100000:0.0:1787579867.409405:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262735104 00000100:00100000:0.0:1787579867.409409:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262735104 00000100:00100000:0.0:1787579867.409520:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787579867.409527:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f84c1642 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+11:5834:x1874413262735104:12345-0@lo:501: 00000100:00100000:0.0:1787579867.410170:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f84c1642 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+11:5834:x1874413262735104:12345-0@lo:501: Request processed in 643us (867us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579867.410179:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787579867.411105:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002a3d239e pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5834:1874413262735104:0@lo:501: 00000100:00100000:1.0:1787579867.411149:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002a3d239e pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5834:1874413262735232:0@lo:503: 00000100:00100000:1.0:1787579867.411202:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579867.411295:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set 000000009f1bfb63 going to sleep for 11 seconds 00000100:00100000:2.0:1787579867.411404:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262735232 00000100:00100000:2.0:1787579867.411411:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262735232 00000100:00100000:2.0:1787579867.411449:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787579867.411456:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003039b58d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+11:5834:x1874413262735232:12345-0@lo:503: 00000040:00080000:2.0:1787579867.411505:0:5847:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787579867.411546:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003039b58d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+11:5834:x1874413262735232:12345-0@lo:503: Request processed in 90us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579867.411554:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787579867.411633:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002a3d239e pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5834:1874413262735232:0@lo:503: 00000040:00080000:2.0:1787579867.412514:0:5879:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1787579867.412728:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1787579867.412747:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787579867.412763:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: 000000003590f4d0/0xc86deac208337485 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac20833748c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579867.412772:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: 000000003590f4d0/0xc86deac208337485 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac20833748c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787579867.412822:0:5834:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787579867.412825:0:5834:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8fae6a238800 10000000:01000000:1.0:1787579867.412828:0:5834:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8fae6a238800 10000000:01000000:1.0:1787579867.412832:0:5834:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787579867.412838:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8fae6a238800 from 1 10000000:01000000:1.0:1787579867.412840:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787579867.412868:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: 0000000094f0d58e/0xc86deac208337493 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579867.412876:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: 0000000094f0d58e/0xc86deac208337493 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579867.412898:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: 0000000094f0d58e/0xc86deac208337493 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579867.412913:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002a3d239e pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5834:1874413262735360:0@lo:101: 00000100:00100000:1.0:1787579867.412964:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579867.412995:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set 00000000402d7686 going to sleep for 11 seconds 00000100:00100000:2.0:1787579867.413091:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262735360 00000100:00100000:2.0:1787579867.413096:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262735360 00000100:00100000:2.0:1787579867.413124:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787579867.413131:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000061abcf76 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+11:5834:x1874413262735360:12345-0@lo:101: 00010000:00010000:2.0:1787579867.413143:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787579867.413154:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000bf615d96/0xc86deac20833749a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc86deac208337493 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579867.413174:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bf615d96/0xc86deac20833749a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc86deac208337493 expref: 12 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579867.413182:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000bf615d96/0xc86deac20833749a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac208337493 expref: 12 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579867.413191:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000bf615d96, rc 0) 00000100:00100000:2.0:1787579867.413232:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000061abcf76 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+12:5834:x1874413262735360:12345-0@lo:101: Request processed in 101us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579867.413238:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787579867.413330:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002a3d239e pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5834:1874413262735360:0@lo:101: 00010000:00010000:1.0:1787579867.413341:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: 0000000094f0d58e/0xc86deac208337493 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac20833749a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579867.413349:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: 0000000094f0d58e/0xc86deac208337493 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc86deac20833749a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579867.413423:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002a3d239e pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5834:1874413262735488:0@lo:501: 00000100:00100000:1.0:1787579867.413447:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579867.413461:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set 00000000402d7686 going to sleep for 11 seconds 00000100:00100000:2.0:1787579867.413526:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262735488 00000100:00100000:2.0:1787579867.413531:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262735488 00000100:00100000:2.0:1787579867.413549:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787579867.413554:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ac5e96d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+12:5834:x1874413262735488:12345-0@lo:501: 00000100:00100000:2.0:1787579867.413807:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ac5e96d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+12:5834:x1874413262735488:12345-0@lo:501: Request processed in 253us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579867.413814:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787579867.421045:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002a3d239e pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5834:1874413262735488:0@lo:501: 00000100:00100000:1.0:1787579867.421113:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002a3d239e pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5834:1874413262735616:0@lo:503: 00000100:00100000:1.0:1787579867.421197:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579867.421246:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set 00000000402d7686 going to sleep for 11 seconds 00000100:00100000:2.0:1787579867.421304:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262735616 00000100:00100000:2.0:1787579867.421312:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262735616 00000100:00100000:2.0:1787579867.421351:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787579867.421359:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007cab6600 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+12:5834:x1874413262735616:12345-0@lo:503: 00000100:00100000:2.0:1787579867.421748:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007cab6600 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+12:5834:x1874413262735616:12345-0@lo:503: Request processed in 389us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579867.421757:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787579867.422100:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002a3d239e pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5834:1874413262735616:0@lo:503: 00000100:00100000:0.0:1787579867.422970:0:5880:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000ccd8eb4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5880:1874413262735744:0@lo:502: 00000100:00100000:0.0:1787579867.423046:0:5880:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579867.423085:0:5880:0:(client.c:2715:ptlrpc_set_wait()) set 00000000dbbaaff6 going to sleep for 11 seconds 00000100:00100000:2.0:1787579867.423188:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262735744 00000100:00100000:2.0:1787579867.423195:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262735744 00000100:00100000:2.0:1787579867.423243:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787579867.423252:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fdfab50b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+12:5880:x1874413262735744:12345-0@lo:502: 00000100:00100000:2.0:1787579867.423553:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fdfab50b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+12:5880:x1874413262735744:12345-0@lo:502: Request processed in 302us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579867.423561:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787579867.424086:0:5880:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000ccd8eb4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5880:1874413262735744:0@lo:502: 00000020:01000004:0.0:1787579867.424150:0:5880:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1787579867.424164:0:5880:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000007d29c2fe) 00000020:00000080:0.0:1787579867.424184:0:5880:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1787579867.424269:0:5880:0:(tgt_mount.c:153:server_get_mount()) get mount 000000005ad218bb from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787579867.424274:0:5880:0:(tgt_mount.c:187:server_put_mount()) put mount 000000005ad218bb from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787579867.424276:0:5880:0:(obd_mount.c:710:lustre_put_lsi()) put 000000005ad218bb 4 00010000:00080000:0.0:1787579867.424302:0:5880:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000ae978d39@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.136@tcp at head 00010000:00010000:0.0:1787579867.425943:0:5880:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1787579867.426150:0:5880:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1787579867.426180:0:5880:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787579867.426189:0:5880:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xc86deac2083374a8 00000100:00080000:0.0:1787579867.426198:0:5880:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787579867.426202:0:5880:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000ae978d39 using connection 192.168.202.136@tcp/0@lo 00000100:00100000:0.0:1787579867.426233:0:5880:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000000ccd8eb4 x1874413262735872/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787579867.426260:0:5880:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787579867.434505:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000ccd8eb4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874413262735872:0@lo:38: 00000100:00100000:2.0:1787579867.434588:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579867.438697:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262735872 00000100:00100000:1.0:1787579867.438711:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262735872 00000100:00100000:1.0:1787579867.438755:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787579867.438763:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a3016e2f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3313:x1874413262735872:12345-0@lo:38: 00000100:00100000:1.0:1787579867.438892:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a3016e2f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3313:x1874413262735872:12345-0@lo:38: Request processed in 128us (4305us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787579867.438917:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787579867.440101:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787579867.440112:0:3313:0:(import.c:65:import_set_state_nolock()) 00000000ae978d39 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787579867.440130:0:3313:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787579867.440134:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000ccd8eb4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874413262735872:0@lo:38: 00000100:00100000:2.0:1787579867.447236:0:5880:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001c7a756e pname:cluuid:pid:xid:nid:opc:job llog_process_th:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5880:1874413262736000:0@lo:502: 00000100:00100000:2.0:1787579867.447339:0:5880:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579867.447403:0:5880:0:(client.c:2715:ptlrpc_set_wait()) set 00000000410d3677 going to sleep for 11 seconds 00000100:00100000:1.0:1787579867.447465:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262736000 00000100:00100000:1.0:1787579867.447473:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262736000 00000100:00100000:1.0:1787579867.447522:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787579867.447531:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000060a782c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+12:5880:x1874413262736000:12345-0@lo:502: 00000100:00100000:1.0:1787579867.447747:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000060a782c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+12:5880:x1874413262736000:12345-0@lo:502: Request processed in 216us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579867.447755:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787579867.449072:0:5880:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001c7a756e pname:cluuid:pid:xid:nid:opc:job llog_process_th:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5880:1874413262736000:0@lo:502: 00000040:00080000:2.0:1787579867.449121:0:5880:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:3.0:1787579867.452175:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:3.0:1787579867.452214:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787579867.452278:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: 0000000094f0d58e/0xc86deac208337493 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac20833749a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579867.452310:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: 0000000094f0d58e/0xc86deac208337493 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac20833749a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787579867.452368:0:5834:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787579867.452370:0:5834:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787579867.452372:0:5834:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787579867.452372:0:5834:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787579867.452374:0:5834:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787579867.452375:0:5834:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787579867.452376:0:5834:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787579867.452378:0:5834:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787579867.452379:0:5834:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787579867.458011:0:5834:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787579867.458018:0:5834:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787579867.458020:0:5834:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787579867.458024:0:5834:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:3.0:1787579867.458029:0:5834:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787579867.458030:0:5834:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787579867.458032:0:5834:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787579867.458033:0:5834:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787579867.458035:0:5834:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787579867.458036:0:5834:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787579867.458037:0:5834:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787579867.458039:0:5834:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787579867.458040:0:5834:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787579867.458041:0:5834:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787579867.458042:0:5834:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787579867.458043:0:5834:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787579867.458105:0:5834:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787579867.458126:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ece4dbd0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5834:1874413262736128:0@lo:253: 00000100:00100000:3.0:1787579867.458201:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579867.458253:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d8bc6d60 going to sleep for 11 seconds 00000100:00100000:1.0:1787579867.458956:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262736128 00000100:00100000:1.0:1787579867.458964:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262736128 00000100:00100000:1.0:1787579867.459020:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787579867.459027:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bf32ca7b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+12:5834:x1874413262736128:12345-0@lo:253: 20000000:01000000:1.0:1787579867.459053:0:5848:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787579867.459065:0:5848:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787579867.555673:0:5848:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787579867.555707:0:5848:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1787579867.555947:0:5868:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787579867.555953:0:5868:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787579867.555975:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000ef9ae087/0xc86deac2083374af lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579867.556008:0:5868:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000013bb10a8/0xc86deac20833747e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac208337477 expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579867.556016:0:5868:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000ef9ae087/0xc86deac2083374af lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579867.556053:0:5868:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000013bb10a8/0xc86deac20833747e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc86deac208337477 expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579867.556069:0:5868:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000013bb10a8/0xc86deac20833747e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc86deac208337477 expref: 12 pid: 5845 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579867.556083:0:5868:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000016cb84ec pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5868:1874413262736256:0@lo:104: 00000100:00100000:3.0:1787579867.556141:0:5868:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579867.556203:0:5868:0:(client.c:2715:ptlrpc_set_wait()) set 000000001d5d8249 going to sleep for 11 seconds 00000100:00100000:1.0:1787579867.557272:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262736256 00000100:00100000:1.0:1787579867.557282:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262736256 00000100:00100000:1.0:1787579867.557334:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787579867.557343:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000229c5973 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+3:5868:x1874413262736256:12345-0@lo:104: 00010000:00010000:1.0:1787579867.557356:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.136@tcp lock: 0000000015ab0d76/0xc86deac208337477 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc86deac20833747e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579867.557445:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787579867.557451:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000229c5973 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+3:5868:x1874413262736256:12345-0@lo:104: Request processed in 110us (1310us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579867.557458:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787579867.557547:0:5868:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000016cb84ec pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5868:1874413262736256:0@lo:104: 00010000:00010000:3.0:1787579867.557564:0:5868:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000ef9ae087/0xc86deac2083374af lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579867.557665:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787579867.557671:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.136@tcp lock: 0000000015ab0d76/0xc86deac208337477 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc86deac20833747e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579867.557689:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000015ab0d76 already unused, calling callback (00000000cc95cb78) 10000000:00010000:2.0:1787579867.557692:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.136@tcp lock: 0000000015ab0d76/0xc86deac208337477 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc86deac20833747e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579867.557700:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: 0000000015ab0d76/0xc86deac208337477 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc86deac20833747e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787579867.557706:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: 0000000015ab0d76/0xc86deac208337477 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc86deac20833747e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787579867.557712:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787579867.557746:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.136@tcp lock: 0000000015ab0d76/0xc86deac208337477 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac20833747e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579867.557752:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787579867.557773:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.136@tcp lock: 0000000015ab0d76/0xc86deac208337477 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac20833747e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579867.557790:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: 0000000015ab0d76/0xc86deac208337477 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac20833747e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579867.557806:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579867.557808:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579867.557809:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787579867.557882:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787579867.557891:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001c7a756e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3314:1874413262736384:0@lo:103: 00000100:00100000:2.0:1787579867.557926:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579867.557965:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262736384 00000100:00100000:2.0:1787579867.557969:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262736384 00010000:00010000:2.0:1787579867.557984:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000013bb10a8/0xc86deac20833747e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc86deac208337477 expref: 13 pid: 5845 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579867.558003:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787579867.558008:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009ed8c874 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+13:3314:x1874413262736384:12345-0@lo:103: 00010000:00010000:2.0:1787579867.558017:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787579867.558020:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000013bb10a8/0xc86deac20833747e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc86deac208337477 expref: 13 pid: 5845 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579867.558030:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000013bb10a8/0xc86deac20833747e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc86deac208337477 expref: 13 pid: 5845 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579867.558043:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000013bb10a8/0xc86deac20833747e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc86deac208337477 expref: 13 pid: 5845 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579867.558054:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000ef9ae087/0xc86deac2083374af lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579867.558061:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ef9ae087/0xc86deac2083374af lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787579867.558073:0:5838:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002121421s 00010000:00010000:2.0:1787579867.558076:0:5838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ef9ae087/0xc86deac2083374af lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579867.558082:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ef9ae087/0xc86deac2083374af lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579867.558097:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000ef9ae087/0xc86deac2083374af lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579867.558102:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000ef9ae087/0xc86deac2083374af lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579867.558107:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ef9ae087 already unused, calling callback (000000001d5ed376) 00010000:00010000:2.0:1787579867.558110:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000ef9ae087/0xc86deac2083374af lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579867.558115:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000ef9ae087/0xc86deac2083374af lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579867.558126:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000ef9ae087/0xc86deac2083374af lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579867.558134:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787579867.558160:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009ed8c874 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+12:3314:x1874413262736384:12345-0@lo:103: Request processed in 152us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579867.558167:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787579867.558191:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001c7a756e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3314:1874413262736384:0@lo:103: 00010000:00010000:2.0:1787579867.558204:0:5868:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000ef9ae087/0xc86deac2083374af lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579867.558211:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000ef9ae087/0xc86deac2083374af lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579867.558217:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ef9ae087/0xc86deac2083374af lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579867.573127:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bf32ca7b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+11:5834:x1874413262736128:12345-0@lo:253: Request processed in 114093us (114919us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579867.573142:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787579867.573240:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ece4dbd0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5834:1874413262736128:0@lo:253: 10000000:01000000:0.0:1787579867.573254:0:5834:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787579867.573257:0:5834:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787579867.573259:0:5834:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787579867.573261:0:5834:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787579867.573262:0:5834:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787579867.573263:0:5834:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787579867.573264:0:5834:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787579867.573265:0:5834:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787579867.573267:0:5834:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787579867.573280:0:5834:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787579867.573281:0:5834:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787579867.573283:0:5834:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787579867.573285:0:5834:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787579867.573297:0:5834:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787579867.587341:0:5834:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1787579867.589322:0:5834:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787579867.589586:0:5834:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1787579867.590066:0:5834:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787579867.590259:0:5834:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1787579867.590442:0:5834:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1787579867.593061:0:5834:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1787579867.593286:0:5834:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1787579867.593496:0:5834:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1787579867.594200:0:5834:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1787579867.594432:0:5834:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1787579867.596240:0:5834:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00010000:00010000:1.0:1787579867.652992:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 40000000:02000000:1.0:1787579867.721478:0:5834:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:0.0:1787579867.813535:0:5834:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1787579867.813995:0:5885:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1787579867.813999:0:5885:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:2.0:1787579867.814085:0:5886:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1787579867.823154:0:5834:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1787579867.823316:0:5834:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1787579867.825766:0:5834:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1787579867.825787:0:5834:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1787579867.826227:0:5834:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787579867.827444:0:5834:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1787579867.828127:0:5834:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1787579867.828152:0:5834:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1787579867.828347:0:5834:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1787579867.828576:0:5834:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:3.0:1787579867.846740:0:5834:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1787579867.846948:0:5834:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1787579867.847070:0:5834:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1787579867.847216:0:5834:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1787579867.847351:0:5834:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1787579867.847494:0:5834:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1787579867.847624:0:5834:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1787579867.847740:0:5834:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1787579867.847886:0:5834:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1787579867.848008:0:5834:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1787579867.851595:0:5834:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1787579867.852255:0:5834:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1787579867.853004:0:5834:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1787579867.853137:0:5834:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1787579867.854063:0:5834:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1787579867.854255:0:5834:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1787579867.856034:0:5834:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1787579867.856203:0:5834:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1787579867.856966:0:5834:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1787579867.857097:0:5834:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1787579867.857241:0:5834:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1787579867.859891:0:5834:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1787579867.860080:0:5834:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1787579867.860200:0:5834:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1787579867.862845:0:5834:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1787579867.863017:0:5834:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1787579867.863158:0:5834:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1787579867.863290:0:5834:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1787579867.863449:0:5834:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1787579867.863610:0:5834:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1787579867.863744:0:5834:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1787579867.863878:0:5834:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1787579867.864063:0:5834:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:1.0:1787579867.910030:0:5886:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:3.0:1787579868.041997:0:5834:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1787579868.042035:0:5834:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa15781c8b988 00100000:10000000:3.0:1787579868.042043:0:5834:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1787579868.043068:0:5834:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787579868.043082:0:5834:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.136@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787579868.043095:0:5834:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1787579868.043126:0:5834:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:1.0:1787579868.105843:0:5886:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787579868.105936:0:5886:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 1, retries 0 00000004:00080000:1.0:1787579868.105941:0:5886:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:2.0:1787579868.660673:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579869.684060:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579870.709933:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579871.732043:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787579872.744034:0:6129:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg236-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787579872.767912:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787579872.883603:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787579872.883615:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787579872.883618:0:8:0:(import.c:65:import_set_state_nolock()) 00000000ae978d39 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787579872.883630:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000ae978d39 using connection 192.168.202.136@tcp/0@lo 00000100:00100000:2.0:1787579872.883655:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000a3907fb1 x1874413262736640/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787579872.883830:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787579872.883845:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001c7a756e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3317:1874413262736512:0@lo:400: 00000100:00100000:0.0:1787579872.883936:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579872.884011:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a3907fb1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874413262736640:0@lo:38: 00000100:00100000:0.0:1787579872.884045:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579872.884273:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262736512 00000100:00100000:2.0:1787579872.884284:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262736512 00000100:00100000:2.0:1787579872.884338:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787579872.884346:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000019be30a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+11:3317:x1874413262736512:12345-0@lo:400: 00000100:00100000:2.0:1787579872.884425:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000019be30a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+11:3317:x1874413262736512:12345-0@lo:400: Request processed in 80us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579872.884433:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787579872.884470:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262736640 00000100:00100000:2.0:1787579872.884474:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262736640 00000100:00100000:2.0:1787579872.884493:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787579872.884497:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ef446e7d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3313:x1874413262736640:12345-0@lo:38: 00010000:00080000:2.0:1787579872.884519:0:5854:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 220 last 0 00000020:00000080:2.0:1787579872.884557:0:5854:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xc86deac2083374b6 00000004:00100000:2.0:1787579872.884606:0:5854:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787579872.884776:0:5854:0:(import.c:65:import_set_state_nolock()) 0000000023417595 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787579872.884828:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ef446e7d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874413262736640:12345-0@lo:38: Request processed in 330us (783us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579872.884836:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787579872.885093:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000a3907fb1 x1874413262736640/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787579882 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787579872.885107:0:3313:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1787579872.885114:0:3313:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1787579872.885118:0:3313:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787579872.885120:0:3313:0:(import.c:65:import_set_state_nolock()) 00000000ae978d39 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787579872.885124:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a3907fb1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874413262736640:0@lo:38: 00000100:00100000:2.0:1787579872.885159:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001c7a756e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3317:1874413262736512:0@lo:400: 00010000:00010000:2.0:1787579873.780051:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579874.803641:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787579875.443434:0:5850:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787579875.443443:0:5850:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8fae6a238800 from 3 10000000:01000000:3.0:1787579875.443449:0:5850:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787579875.443499:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: 00000000d4a4c9aa/0xc86deac2083374bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579875.443514:0:5850:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: 00000000d4a4c9aa/0xc86deac2083374bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579875.443527:0:5850:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: 00000000d4a4c9aa/0xc86deac2083374bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579875.443762:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000016cb84ec pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262736768:0@lo:101: 00000100:00100000:3.0:1787579875.445273:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579875.445378:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d309db09 going to sleep for 11 seconds 00000100:00100000:1.0:1787579875.451018:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262736768 00000100:00100000:1.0:1787579875.451031:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262736768 00000100:00100000:1.0:1787579875.451094:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787579875.451104:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003914c56f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+11:5850:x1874413262736768:12345-0@lo:101: 00010000:00010000:1.0:1787579875.451124:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787579875.451149:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d18b6e90/0xc86deac2083374c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc86deac2083374bd expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579875.451178:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d18b6e90/0xc86deac2083374c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc86deac2083374bd expref: 12 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579875.451189:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d18b6e90/0xc86deac2083374c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac2083374bd expref: 12 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579875.451200:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d18b6e90, rc 0) 00000100:00100000:1.0:1787579875.451327:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003914c56f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+12:5850:x1874413262736768:12345-0@lo:101: Request processed in 224us (6059us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579875.451335:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787579875.459371:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000016cb84ec pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262736768:0@lo:101: 00010000:00010000:3.0:1787579875.459664:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: 00000000d4a4c9aa/0xc86deac2083374bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac2083374c4 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579875.459680:0:5850:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: 00000000d4a4c9aa/0xc86deac2083374bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc86deac2083374c4 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579875.461248:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000016cb84ec pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262736896:0@lo:256: 00000100:00100000:3.0:1787579875.461377:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579875.461441:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262736896 00000100:00100000:0.0:1787579875.461451:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262736896 00000100:00100000:3.0:1787579875.461452:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d309db09 going to sleep for 11 seconds 00000100:00100000:0.0:1787579875.461502:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787579875.461513:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000126d0a9f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+12:5850:x1874413262736896:12345-0@lo:256: 20000000:01000000:0.0:1787579875.461543:0:5845:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787579875.461565:0:5845:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787579875.461569:0:5845:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1787579875.461676:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000126d0a9f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+12:5850:x1874413262736896:12345-0@lo:256: Request processed in 165us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579875.461767:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000016cb84ec pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262736896:0@lo:256: 00000100:00100000:0.0:1787579875.461810:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 10000000:01000000:3.0:1787579875.461890:0:5850:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787579875.461898:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: 00000000d4a4c9aa/0xc86deac2083374bd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac2083374c4 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579875.461908:0:5850:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: 00000000d4a4c9aa/0xc86deac2083374bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac2083374c4 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579875.828531:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579876.852750:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787579877.875499:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787579878.003564:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a3907fb1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874413262737152:0@lo:400: 00000100:00100000:2.0:1787579878.003635:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579878.003956:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787579878.003967:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001c7a756e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3316:1874413262737024:0@lo:400: 00000100:00100000:1.0:1787579878.004015:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579878.004166:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262737024 00000100:00100000:2.0:1787579878.004174:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262737024 00000100:00100000:2.0:1787579878.004227:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787579878.004237:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ba480bee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+12:3316:x1874413262737024:12345-0@lo:400: 00000100:00100000:2.0:1787579878.004285:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ba480bee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+12:3316:x1874413262737024:12345-0@lo:400: Request processed in 51us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579878.004293:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787579878.004505:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262737152 00000100:00100000:0.0:1787579878.004761:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262737152 00000100:00100000:0.0:1787579878.004914:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787579878.004922:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000081aa74d0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874413262737152:12345-0@lo:400: 00000100:00100000:0.0:1787579878.004974:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000081aa74d0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874413262737152:12345-0@lo:400: Request processed in 54us (1340us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579878.005049:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787579878.005113:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000a3907fb1 x1874413262737152/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787579894 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787579878.005127:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a3907fb1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874413262737152:0@lo:400: 00000100:00100000:1.0:1787579878.005254:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001c7a756e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3316:1874413262737024:0@lo:400: 00000020:00000080:3.0:1787579878.706168:0:6332:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd1d54d2c0 20000000:00000080:3.0:1787579878.706186:0:6332:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8fae5076d000 uarg=0000000000000000 20000000:01000000:3.0:1787579878.706219:0:6332:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1787579878.706226:0:6332:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1787579878.706230:0:6332:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1787579878.706593:0:6332:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1787579878.706606:0:6332:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1787579878.725038:0:6332:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787579878.726665:0:6332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1787579878.726771:0:6332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1787579878.726837:0:6332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1787579878.726856:0:6332:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787579878.726873:0:6332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000ad9908bb/0xc86deac2083374cb lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579878.726891:0:6332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000c1e7d2fc/0xc86deac20833748c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac208337485 expref: 11 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579878.726899:0:6332:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000ad9908bb/0xc86deac2083374cb lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579878.726953:0:6332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000c1e7d2fc/0xc86deac20833748c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc86deac208337485 expref: 11 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579878.726971:0:6332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000c1e7d2fc/0xc86deac20833748c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc86deac208337485 expref: 11 pid: 5848 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579878.726986:0:6332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d8733ac0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6332:1874413262737280:0@lo:104: 00000100:00100000:2.0:1787579878.727047:0:6332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579878.727428:0:6332:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b93bb179 going to sleep for 11 seconds 00000100:00100000:0.0:1787579878.727835:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262737280 00000100:00100000:0.0:1787579878.727844:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262737280 00000100:00100000:0.0:1787579878.727895:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787579878.727904:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b4bb091c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+3:6332:x1874413262737280:12345-0@lo:104: 00010000:00010000:0.0:1787579878.728036:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.136@tcp lock: 000000003590f4d0/0xc86deac208337485 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc86deac20833748c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579878.728122:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787579878.728128:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b4bb091c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+3:6332:x1874413262737280:12345-0@lo:104: Request processed in 226us (1081us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579878.728135:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1787579878.728194:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787579878.728200:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.136@tcp lock: 000000003590f4d0/0xc86deac208337485 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc86deac20833748c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579878.728207:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003590f4d0 already unused, calling callback (00000000cc95cb78) 10000000:00010000:3.0:1787579878.728220:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.136@tcp lock: 000000003590f4d0/0xc86deac208337485 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc86deac20833748c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579878.728227:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: 000000003590f4d0/0xc86deac208337485 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc86deac20833748c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787579878.728234:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: 000000003590f4d0/0xc86deac208337485 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc86deac20833748c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787579878.728240:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787579878.728285:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.136@tcp lock: 000000003590f4d0/0xc86deac208337485 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac20833748c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579878.728292:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787579878.728319:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.136@tcp lock: 000000003590f4d0/0xc86deac208337485 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac20833748c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579878.728326:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: 000000003590f4d0/0xc86deac208337485 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac20833748c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579878.728343:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579878.728345:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579878.728346:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787579878.728353:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787579878.728364:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000016cb84ec pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3314:1874413262737408:0@lo:103: 00000100:00100000:3.0:1787579878.728422:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579878.728460:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262737408 00000100:00100000:3.0:1787579878.728465:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262737408 00010000:00010000:3.0:1787579878.728484:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000c1e7d2fc/0xc86deac20833748c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc86deac208337485 expref: 12 pid: 5848 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579878.728521:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787579878.728528:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000010bfe3ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+12:3314:x1874413262737408:12345-0@lo:103: 00010000:00010000:3.0:1787579878.728539:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787579878.728543:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000c1e7d2fc/0xc86deac20833748c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc86deac208337485 expref: 12 pid: 5848 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579878.728553:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000c1e7d2fc/0xc86deac20833748c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc86deac208337485 expref: 12 pid: 5848 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579878.728568:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000ad9908bb/0xc86deac2083374cb lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579878.728581:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ad9908bb/0xc86deac2083374cb lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579878.728593:0:5838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ad9908bb/0xc86deac2083374cb lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579878.728599:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ad9908bb/0xc86deac2083374cb lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579878.728605:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000ad9908bb/0xc86deac2083374cb lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579878.728611:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000ad9908bb/0xc86deac2083374cb lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579878.728616:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ad9908bb already unused, calling callback (000000001d5ed376) 00010000:00010000:3.0:1787579878.728620:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000ad9908bb/0xc86deac2083374cb lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579878.728626:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000ad9908bb/0xc86deac2083374cb lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579878.728633:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000ad9908bb/0xc86deac2083374cb lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579878.728642:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787579878.728671:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000010bfe3ff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+12:3314:x1874413262737408:12345-0@lo:103: Request processed in 145us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579878.728695:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787579878.728731:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000016cb84ec pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3314:1874413262737408:0@lo:103: 00010000:00010000:2.0:1787579878.729483:0:6332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c1e7d2fc/0xc86deac20833748c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc86deac208337485 expref: 11 pid: 5848 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579878.729497:0:6332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d8733ac0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6332:1874413262737280:0@lo:104: 00010000:00010000:2.0:1787579878.729519:0:6332:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000ad9908bb/0xc86deac2083374cb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579878.729527:0:6332:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000ad9908bb/0xc86deac2083374cb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579878.729532:0:6332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000ad9908bb/0xc86deac2083374cb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579878.729545:0:6332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ad9908bb/0xc86deac2083374cb lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579878.901734:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579879.923898:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787579880.947714:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787579880.947882:0:5850:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787579880.947887:0:5850:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8fae6a238800 from 1 10000000:01000000:3.0:1787579880.947892:0:5850:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787579880.947952:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: 000000009221ff3e/0xc86deac2083374d2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579880.947967:0:5850:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: 000000009221ff3e/0xc86deac2083374d2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579880.947977:0:5850:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: 000000009221ff3e/0xc86deac2083374d2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579880.948003:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000016cb84ec pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262737536:0@lo:101: 00000100:00100000:3.0:1787579880.948075:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579880.948128:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f6f652eb going to sleep for 11 seconds 00000100:00100000:0.0:1787579880.949136:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262737536 00000100:00100000:0.0:1787579880.949146:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262737536 00000100:00100000:0.0:1787579880.949210:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787579880.949219:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009e08f068 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+11:5850:x1874413262737536:12345-0@lo:101: 00010000:00010000:0.0:1787579880.949233:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787579880.949249:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000041801157/0xc86deac2083374d9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc86deac2083374d2 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579880.949272:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000041801157/0xc86deac2083374d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc86deac2083374d2 expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579880.949280:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000041801157/0xc86deac2083374d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac2083374d2 expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579880.949289:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000041801157, rc 0) 00000100:00100000:0.0:1787579880.949349:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009e08f068 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+12:5850:x1874413262737536:12345-0@lo:101: Request processed in 132us (1275us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579880.949367:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787579880.949598:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000016cb84ec pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262737536:0@lo:101: 00010000:00010000:3.0:1787579880.949614:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: 000000009221ff3e/0xc86deac2083374d2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac2083374d9 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579880.949622:0:5850:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: 000000009221ff3e/0xc86deac2083374d2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc86deac2083374d9 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579880.949830:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000016cb84ec pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262737664:0@lo:501: 00000100:00100000:2.0:1787579880.949868:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579880.949905:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set 000000000513b3f4 going to sleep for 11 seconds 00000100:00100000:3.0:1787579880.949958:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262737664 00000100:00100000:3.0:1787579880.949963:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262737664 00000100:00100000:3.0:1787579880.949992:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787579880.949998:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004f75d9f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+12:5850:x1874413262737664:12345-0@lo:501: 00000100:00100000:3.0:1787579880.950248:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004f75d9f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+12:5850:x1874413262737664:12345-0@lo:501: Request processed in 249us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579880.950263:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787579880.950331:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000016cb84ec pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262737664:0@lo:501: 00000100:00100000:2.0:1787579880.950357:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d8733ac0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262737792:0@lo:503: 00000100:00100000:2.0:1787579880.950418:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579880.950435:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set 000000000513b3f4 going to sleep for 11 seconds 00000100:00100000:3.0:1787579880.950532:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262737792 00000100:00100000:3.0:1787579880.950536:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262737792 00000100:00100000:3.0:1787579880.950567:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787579880.950574:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ad0091cf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+12:5850:x1874413262737792:12345-0@lo:503: 00000100:00100000:3.0:1787579880.950710:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ad0091cf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+12:5850:x1874413262737792:12345-0@lo:503: Request processed in 137us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579880.950717:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787579880.950867:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d8733ac0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262737792:0@lo:503: 00000100:00100000:3.0:1787579880.965539:0:6386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000004e65ad8 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:6386:1874413262737920:0@lo:502: 00000100:00100000:3.0:1787579880.965615:0:6386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579880.965669:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262737920 00000100:00100000:3.0:1787579880.965672:0:6386:0:(client.c:2715:ptlrpc_set_wait()) set 0000000031d35c39 going to sleep for 11 seconds 00000100:00100000:1.0:1787579880.965677:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262737920 00000100:00100000:1.0:1787579880.965732:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787579880.965743:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cfa65692 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+12:6386:x1874413262737920:12345-0@lo:502: 00000100:00100000:1.0:1787579880.965954:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cfa65692 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+12:6386:x1874413262737920:12345-0@lo:502: Request processed in 213us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579880.965962:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787579880.966856:0:6386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000004e65ad8 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:6386:1874413262737920:0@lo:502: 00000020:01000000:3.0:1787579880.966887:0:6386:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787579880.966897:0:6386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787579880.966900:0:6386:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787579880.966906:0:6386:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8fae6a238800 00000020:00000080:3.0:1787579880.966908:0:6386:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787579880.966954:0:6386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5f4af480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:6386:1874413262738048:0@lo:502: 00000100:00100000:3.0:1787579880.966995:0:6386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579880.967011:0:6386:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae5233cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787579880.967372:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262738048 00000100:00100000:1.0:1787579880.967378:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262738048 00000100:00100000:1.0:1787579880.967427:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787579880.967437:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+12:6386:x1874413262738048:12345-0@lo:502: 00000100:00100000:1.0:1787579880.967629:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+12:6386:x1874413262738048:12345-0@lo:502: Request processed in 193us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579880.967637:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787579880.967696:0:6386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5f4af480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:6386:1874413262738048:0@lo:502: 00000020:01000000:3.0:1787579880.967715:0:6386:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787579880.967720:0:6386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787579880.967721:0:6386:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1787579880.967725:0:6386:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1787579880.969772:0:5850:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1787579880.969807:0:5850:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787579880.969819:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae4150ec00/0xc86deac2083374d2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac2083374d9 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579880.969832:0:5850:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff8fae4150ec00/0xc86deac2083374d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac2083374d9 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579881.973691:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787579882.997933:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787579883.142701:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae48c91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3316:1874413262738176:0@lo:400: 00000100:00100000:1.0:1787579883.142793:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579883.142864:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262738176 00000100:00100000:1.0:1787579883.142872:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262738176 00000100:00100000:1.0:1787579883.142913:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787579883.142922:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+12:3316:x1874413262738176:12345-0@lo:400: 00000100:00100000:1.0:1787579883.143226:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+12:3316:x1874413262738176:12345-0@lo:400: Request processed in 305us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579883.143234:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787579883.143284:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae48c91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3316:1874413262738176:0@lo:400: 00000100:00100000:1.0:1787579883.143320:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae48c91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874413262738304:0@lo:400: 00000100:00100000:1.0:1787579883.143407:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579883.143440:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262738304 00000100:00100000:1.0:1787579883.143444:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262738304 00000100:00100000:1.0:1787579883.143572:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787579883.143579:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874413262738304:12345-0@lo:400: 00000100:00100000:1.0:1787579883.143612:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874413262738304:12345-0@lo:400: Request processed in 34us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579883.143618:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787579883.143656:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8fae48c91c00 x1874413262738304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787579899 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787579883.143668:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae48c91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874413262738304:0@lo:400: 00010000:00010000:2.0:1787579884.022110:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579885.050751:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579886.068953:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787579887.092069:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579888.123641:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787579888.249086:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5f4ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874413262738560:0@lo:400: 00000100:00100000:2.0:1787579888.249172:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579888.249250:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787579888.249257:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5f4af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3315:1874413262738432:0@lo:400: 00000100:00100000:2.0:1787579888.249288:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579888.249434:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262738560 00000100:00100000:3.0:1787579888.249443:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262738560 00000100:00100000:3.0:1787579888.249500:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787579888.249510:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74639500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874413262738560:12345-0@lo:400: 00000100:00100000:3.0:1787579888.249576:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74639500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874413262738560:12345-0@lo:400: Request processed in 67us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579888.249583:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787579888.249635:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8fae5f4ad500 x1874413262738560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787579904 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787579888.249650:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5f4ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874413262738560:0@lo:400: 00000100:00100000:1.0:1787579888.249826:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262738432 00000100:00100000:1.0:1787579888.249831:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262738432 00000100:00100000:1.0:1787579888.249868:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787579888.249875:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+12:3315:x1874413262738432:12345-0@lo:400: 00000100:00100000:1.0:1787579888.249927:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+12:3315:x1874413262738432:12345-0@lo:400: Request processed in 52us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579888.249933:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787579888.250945:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5f4af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3315:1874413262738432:0@lo:400: 00000020:01000004:3.0:1787579888.480575:0:6703:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787579888.480581:0:6703:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1787579888.480791:0:6703:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8fae50613000 00000020:01000004:3.0:1787579888.480807:0:6703:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1787579888.480817:0:6703:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1787579888.480839:0:6703:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8fae6d543370) 00000020:00000080:3.0:1787579888.480855:0:6703:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1787579888.509008:0:6703:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1787579888.509305:0:6703:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1787579888.540003:0:6703:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1787579888.552012:0:6703:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787579888.552048:0:6703:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1787579888.552109:0:6703:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787579888.552881:0:6703:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1787579888.553570:0:6703:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787579888.553963:0:6703:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787579888.553976:0:6703:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc86deac2083374e7 00000020:01000004:2.0:1787579888.553987:0:6703:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1787579888.554009:0:6703:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.136@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787579888.554012:0:6703:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.136@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787579888.554018:0:6703:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787579888.554023:0:6703:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1787579888.554037:0:6703:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8fae521799b8) 00000020:00000080:2.0:1787579888.554051:0:6703:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1787579888.557788:0:6703:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787579888.557977:0:6703:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1787579888.557983:0:6703:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1787579888.563985:0:6703:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1787579888.564000:0:6703:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1787579888.569466:0:6703:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1787579888.569484:0:6703:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1787579888.574060:0:6703:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787579888.574257:0:6703:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1787579888.574265:0:6703:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1787579888.577503:0:6703:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1787579888.577580:0:6703:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1787579888.643086:0:6703:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787579888.643353:0:6703:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787579888.643360:0:6703:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1787579888.649869:0:6703:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787579888.649887:0:6703:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1787579888.650757:0:6703:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787579888.650767:0:6703:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1787579888.660902:0:6703:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787579888.661101:0:6703:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1787579888.661108:0:6703:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1787579888.662128:0:6703:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1787579888.662136:0:6703:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1787579888.775885:0:6703:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787579888.776121:0:6703:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1787579888.776128:0:6703:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1787579888.780171:0:6703:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1787579888.780184:0:6703:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1787579888.781058:0:6703:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1787579888.781084:0:6703:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1787579888.781091:0:6703:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.136@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1787579888.829081:0:6703:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.136@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787579888.829117:0:6703:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.136@tcp, index=0000, flags=0x20062 00000020:01000004:0.0:1787579888.829121:0:6703:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787579888.829123:0:6703:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787579888.829124:0:6703:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787579888.829126:0:6703:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787579888.829127:0:6703:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787579888.829128:0:6703:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787579888.829130:0:6703:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787579888.829132:0:6703:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787579888.829133:0:6703:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787579888.829135:0:6703:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787579888.829136:0:6703:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787579888.829140:0:6703:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:0.0:1787579888.829142:0:6703:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787579888.829143:0:6703:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787579888.829144:0:6703:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787579888.829145:0:6703:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787579888.829146:0:6703:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787579888.829147:0:6703:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787579888.829148:0:6703:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787579888.829149:0:6703:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787579888.829150:0:6703:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787579888.829151:0:6703:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787579888.829152:0:6703:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787579888.829180:0:6703:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787579888.829199:0:6703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7f5bb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:6703:1874413262738688:0@lo:253: 00000100:00100000:0.0:1787579888.829273:0:6703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579888.829345:0:6703:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae48616780 going to sleep for 11 seconds 00000100:00100000:1.0:1787579888.829497:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262738688 00000100:00100000:1.0:1787579888.829504:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262738688 00000100:00100000:1.0:1787579888.829560:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787579888.829569:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+12:6703:x1874413262738688:12345-0@lo:253: 20000000:01000000:1.0:1787579888.829613:0:5845:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1787579888.829617:0:5845:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1787579888.829623:0:5845:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1787579888.829626:0:5845:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1787579888.830299:0:5845:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787579888.830533:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1787579888.830546:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1787579888.830578:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:1.0:1787579888.830584:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1787579888.830629:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:1.0:1787579888.830693:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:1.0:1787579888.830958:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1787579888.830976:0:5845:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.136@tcp 20000000:01000000:1.0:1787579888.830989:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.136@tcp (null) (null) (null) 00000040:00080000:1.0:1787579888.831020:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1787579888.831027:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787579888.831081:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1787579888.831090:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.202.136@tcp (null) (null) 00000040:00080000:1.0:1787579888.831123:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1787579888.831134:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1787579888.831165:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1787579888.831209:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:1.0:1787579888.831822:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1787579888.831837:0:5845:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.136@tcp 20000000:01000000:1.0:1787579888.831839:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.136@tcp (null) (null) (null) 00000040:00080000:1.0:1787579888.831871:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1787579888.831880:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1787579888.831910:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1787579888.831916:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.202.136@tcp (null) (null) 00000040:00080000:1.0:1787579888.831958:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1787579888.831966:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1787579888.831997:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:1.0:1787579888.832030:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:1.0:1787579888.832046:0:5845:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:1.0:1787579888.832050:0:5845:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1787579888.832053:0:5845:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1787579888.832065:0:5845:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787579888.832068:0:5845:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1787579888.832096:0:5845:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787579888.832099:0:5845:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787579888.843090:0:6718:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 9 1->4: lustre sys.timeout 20000000:01000000:2.0:1787579888.843185:0:6718:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 9 2->4: lustre sys.timeout 00000040:00080000:2.0:1787579888.843234:0:6718:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:1.0:1787579888.843854:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:1.0:1787579888.843894:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:1.0:1787579888.844371:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:1.0:1787579888.844412:0:5845:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787579888.844415:0:5845:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787579888.845361:0:6719:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 10 1->4: lustre sys.timeout 20000000:01000000:2.0:1787579888.845435:0:6719:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 10 2->4: lustre sys.timeout 00000040:00080000:2.0:1787579888.845497:0:6719:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1787579888.845890:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:1.0:1787579888.845936:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:1.0:1787579888.845963:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:1.0:1787579888.845973:0:5845:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1787579888.845975:0:5845:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1787579888.846538:0:6720:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:1.0:1787579888.846777:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:1.0:1787579888.846807:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:1.0:1787579888.846868:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:1.0:1787579888.846883:0:5845:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:1.0:1787579888.846885:0:5845:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:1.0:1787579888.846895:0:5845:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1787579888.846924:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8fae4ca58000/0xc86deac2083374f5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579888.846944:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fae4150f200/0xc86deac20833740e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac208337407 expref: 12 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579888.846952:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fae4ca59e00/0xc86deac20833742a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac208337423 expref: 12 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579888.846959:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fae41661200/0xc86deac20833749a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac208337493 expref: 12 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579888.846966:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8fae4ca58000/0xc86deac2083374f5 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579888.847004:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fae41661200/0xc86deac20833749a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc86deac208337493 expref: 12 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579888.847020:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fae41661200/0xc86deac20833749a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc86deac208337493 expref: 12 pid: 5847 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579888.847033:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae48c91c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5845:1874413262738816:0@lo:104: 00000100:00100000:1.0:1787579888.847110:0:5845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787579888.847203:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fae4ca59e00/0xc86deac20833742a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc86deac208337423 expref: 12 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579888.847212:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fae4ca59e00/0xc86deac20833742a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc86deac208337423 expref: 12 pid: 5847 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579888.847220:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae48c92300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5845:1874413262738944:0@lo:104: 00000100:00100000:1.0:1787579888.847238:0:5845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787579888.848420:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fae4150f200/0xc86deac20833740e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc86deac208337407 expref: 12 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579888.848433:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fae4150f200/0xc86deac20833740e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc86deac208337407 expref: 12 pid: 5847 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579888.848443:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae48c90e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5845:1874413262739072:0@lo:104: 00000100:00100000:1.0:1787579888.848472:0:5845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579888.859775:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262738816 00000100:00100000:0.0:1787579888.859791:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262738816 00000100:00100000:2.0:1787579888.859967:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262738944 00000100:00100000:2.0:1787579888.859972:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262738944 00000100:00100000:2.0:1787579888.859990:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787579888.860000:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c92a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+4:5845:x1874413262738816:12345-0@lo:104: 00010000:00010000:2.0:1787579888.860020:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.136@tcp lock: ffff8fae4ca59800/0xc86deac208337493 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc86deac20833749a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579888.860125:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787579888.860132:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c92a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+4:5845:x1874413262738816:12345-0@lo:104: Request processed in 134us (13021us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579888.860139:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787579888.860158:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787579888.860185:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c90700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+3:5845:x1874413262738944:12345-0@lo:104: 00010000:00010000:2.0:1787579888.860195:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.136@tcp lock: ffff8fae40031a00/0xc86deac208337423 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc86deac20833742a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579888.860234:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787579888.860238:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c90700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+3:5845:x1874413262738944:12345-0@lo:104: Request processed in 56us (13000us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579888.860245:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1787579888.860260:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787579888.860266:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.136@tcp lock: ffff8fae4ca59800/0xc86deac208337493 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc86deac20833749a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579888.860273:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae4ca59800 already unused, calling callback (ffffffffc1b77c20) 10000000:00010000:2.0:1787579888.860277:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.136@tcp lock: ffff8fae4ca59800/0xc86deac208337493 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc86deac20833749a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579888.860287:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: ffff8fae4ca59800/0xc86deac208337493 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc86deac20833749a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787579888.860294:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: ffff8fae4ca59800/0xc86deac208337493 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc86deac20833749a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787579888.860300:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787579888.860342:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.136@tcp lock: ffff8fae4ca59800/0xc86deac208337493 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac20833749a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579888.860349:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787579888.860367:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.136@tcp lock: ffff8fae4ca59800/0xc86deac208337493 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac20833749a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579888.860416:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: ffff8fae4ca59800/0xc86deac208337493 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac20833749a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579888.860433:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787579888.860436:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.136@tcp lock: ffff8fae40031a00/0xc86deac208337423 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc86deac20833742a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579888.860442:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae40031a00 already unused, calling callback (ffffffffc1b77c20) 10000000:00010000:2.0:1787579888.860445:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.136@tcp lock: ffff8fae40031a00/0xc86deac208337423 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc86deac20833742a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579888.860451:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: ffff8fae40031a00/0xc86deac208337423 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc86deac20833742a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787579888.860456:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: ffff8fae40031a00/0xc86deac208337423 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc86deac20833742a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787579888.860461:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787579888.860474:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.136@tcp lock: ffff8fae40031a00/0xc86deac208337423 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac20833742a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579888.860480:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787579888.860486:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.136@tcp lock: ffff8fae40031a00/0xc86deac208337423 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac20833742a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579888.860491:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: ffff8fae40031a00/0xc86deac208337423 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac20833742a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579888.860501:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579888.860518:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579888.860520:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787579888.860546:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae74638a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3316:1874413262739200:0@lo:103: 00000100:00100000:2.0:1787579888.860602:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579888.860649:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787579888.860655:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7463b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3316:1874413262739328:0@lo:103: 00000100:00100000:2.0:1787579888.860676:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787579888.861264:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787579888.862123:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262739200 00000100:00100000:0.0:1787579888.862135:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262739200 00010000:00010000:0.0:1787579888.862195:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fae41661200/0xc86deac20833749a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc86deac208337493 expref: 13 pid: 5847 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579888.862234:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262739328 00000100:00100000:0.0:1787579888.862238:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262739328 00010000:00010000:0.0:1787579888.862250:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fae4ca59e00/0xc86deac20833742a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc86deac208337423 expref: 14 pid: 5847 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579888.862265:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787579888.862273:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7463b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+14:3316:x1874413262739200:12345-0@lo:103: 00010000:00010000:0.0:1787579888.862310:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787579888.862316:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fae41661200/0xc86deac20833749a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc86deac208337493 expref: 14 pid: 5847 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579888.862329:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fae41661200/0xc86deac20833749a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc86deac208337493 expref: 14 pid: 5847 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579888.862352:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787579888.862446:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7463b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+14:3316:x1874413262739200:12345-0@lo:103: Request processed in 173us (1843us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579888.862454:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787579888.862470:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787579888.862477:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74639180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+13:3316:x1874413262739328:12345-0@lo:103: 00010000:00010000:0.0:1787579888.862484:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787579888.862488:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fae4ca59e00/0xc86deac20833742a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc86deac208337423 expref: 13 pid: 5847 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579888.862508:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fae4ca59e00/0xc86deac20833742a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc86deac208337423 expref: 13 pid: 5847 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579888.862517:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787579888.862542:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74639180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+13:3316:x1874413262739328:12345-0@lo:103: Request processed in 66us (1865us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579888.862548:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787579888.863001:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7463b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3316:1874413262739328:0@lo:103: 00000100:00100000:2.0:1787579888.863012:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae74638a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3316:1874413262739200:0@lo:103: 00000100:00100000:1.0:1787579888.863329:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae48da3f00 going to sleep for 11 seconds 00010000:00010000:1.0:1787579888.863350:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fae41661200/0xc86deac20833749a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc86deac208337493 expref: 12 pid: 5847 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579888.863365:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae48c91c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5845:1874413262738816:0@lo:104: 00010000:00010000:1.0:1787579888.863376:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fae4ca59e00/0xc86deac20833742a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc86deac208337423 expref: 11 pid: 5847 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579888.863408:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae48c92300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5845:1874413262738944:0@lo:104: 00000100:00100000:2.0:1787579888.863538:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262739072 00000100:00100000:2.0:1787579888.863544:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262739072 00000100:00100000:2.0:1787579888.863576:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787579888.863599:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c90000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+3:5845:x1874413262739072:12345-0@lo:104: 00010000:00010000:2.0:1787579888.863615:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.136@tcp lock: ffff8fae41661600/0xc86deac208337407 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc86deac20833740e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579888.863678:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787579888.863683:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c90000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+3:5845:x1874413262739072:12345-0@lo:104: Request processed in 100us (15211us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579888.863689:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1787579888.863708:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787579888.863716:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.136@tcp lock: ffff8fae41661600/0xc86deac208337407 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc86deac20833740e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579888.863724:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae41661600 already unused, calling callback (ffffffffc1b77c20) 10000000:00010000:2.0:1787579888.863730:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.136@tcp lock: ffff8fae41661600/0xc86deac208337407 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc86deac20833740e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579888.863757:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: ffff8fae41661600/0xc86deac208337407 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc86deac20833740e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787579888.863764:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: ffff8fae41661600/0xc86deac208337407 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc86deac20833740e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787579888.863769:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787579888.863805:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.136@tcp lock: ffff8fae41661600/0xc86deac208337407 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac20833740e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579888.863812:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787579888.863832:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.136@tcp lock: ffff8fae41661600/0xc86deac208337407 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac20833740e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579888.863839:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: ffff8fae41661600/0xc86deac208337407 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac20833740e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579888.863855:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579888.863857:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579888.863858:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787579888.863877:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae74638a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3314:1874413262739456:0@lo:103: 00000100:00100000:2.0:1787579888.863910:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579888.863948:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262739456 00000100:00100000:2.0:1787579888.863952:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262739456 00010000:00010000:2.0:1787579888.863967:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fae4150f200/0xc86deac20833740e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc86deac208337407 expref: 11 pid: 5847 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579888.863984:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787579888.863989:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7463b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+11:3314:x1874413262739456:12345-0@lo:103: 00010000:00010000:2.0:1787579888.864004:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787579888.864009:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fae4150f200/0xc86deac20833740e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc86deac208337407 expref: 11 pid: 5847 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579888.864020:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fae4150f200/0xc86deac20833740e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc86deac208337407 expref: 11 pid: 5847 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579888.864036:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8fae4ca58000/0xc86deac2083374f5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579888.864044:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fae4ca58000/0xc86deac2083374f5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579888.864059:0:5838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fae4ca58000/0xc86deac2083374f5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579888.864066:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fae4ca58000/0xc86deac2083374f5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579888.864073:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8fae4ca58000/0xc86deac2083374f5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579888.864079:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8fae4ca58000/0xc86deac2083374f5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579888.864084:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae4ca58000 already unused, calling callback (ffffffffc155a230) 00010000:00010000:2.0:1787579888.864089:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8fae4ca58000/0xc86deac2083374f5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579888.864096:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8fae4ca58000/0xc86deac2083374f5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579888.864115:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8fae4ca58000/0xc86deac2083374f5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579888.864125:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787579888.864152:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7463b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+11:3314:x1874413262739456:12345-0@lo:103: Request processed in 162us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579888.864158:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787579888.864186:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae74638a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3314:1874413262739456:0@lo:103: 00010000:00010000:1.0:1787579888.864437:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fae4150f200/0xc86deac20833740e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc86deac208337407 expref: 10 pid: 5847 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579888.864449:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae48c90e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5845:1874413262739072:0@lo:104: 00010000:00010000:1.0:1787579888.864479:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8fae4ca58000/0xc86deac2083374f5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579888.864488:0:5845:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8fae4ca58000/0xc86deac2083374f5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579888.864493:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8fae4ca58000/0xc86deac2083374f5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579888.864499:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fae4ca58000/0xc86deac2083374f5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787579888.864523:0:5845:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1787579889.020421:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+9:6703:x1874413262738688:12345-0@lo:253: Request processed in 190802us (191097us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579889.020439:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787579889.020831:0:6703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7f5bb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:6703:1874413262738688:0@lo:253: 10000000:01000000:3.0:1787579889.020848:0:6703:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1787579889.020852:0:6703:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787579889.020854:0:6703:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787579889.020855:0:6703:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787579889.020856:0:6703:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1787579889.020857:0:6703:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787579889.020859:0:6703:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787579889.020860:0:6703:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787579889.020862:0:6703:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1787579889.020863:0:6703:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787579889.020865:0:6703:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787579889.020887:0:6703:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8fae50613000 from lustre-OST0000 10000000:01000000:3.0:1787579889.020915:0:6703:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1787579889.020918:0:6703:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787579889.020926:0:6703:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8fae503119b8 local copy 10000000:01000000:3.0:1787579889.020931:0:6703:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787579889.020972:0:6703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae4150fa00/0xc86deac2083374fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579889.020984:0:6703:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.136@tcp lock: ffff8fae4150fa00/0xc86deac2083374fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579889.020994:0:6703:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff8fae4150fa00/0xc86deac2083374fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579889.021041:0:6703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5f4af480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:6703:1874413262739584:0@lo:101: 00000100:00100000:3.0:1787579889.021082:0:6703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579889.021148:0:6703:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae5f8adc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787579889.021211:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262739584 00000100:00100000:1.0:1787579889.021219:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262739584 00000100:00100000:1.0:1787579889.021265:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787579889.021274:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+9:6703:x1874413262739584:12345-0@lo:101: 00010000:00010000:1.0:1787579889.021297:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787579889.021312:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fae4ca58000/0xc86deac208337503 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc86deac2083374fc expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579889.021337:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fae4ca58000/0xc86deac208337503 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc86deac2083374fc expref: 10 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579889.021348:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fae4ca58000/0xc86deac208337503 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac2083374fc expref: 10 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579889.021357:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae4ca58000, rc 0) 00000100:00100000:1.0:1787579889.021415:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+10:6703:x1874413262739584:12345-0@lo:101: Request processed in 142us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579889.021430:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787579889.021710:0:6703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5f4af480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:6703:1874413262739584:0@lo:101: 00010000:00010000:0.0:1787579889.021724:0:6703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff8fae4150fa00/0xc86deac2083374fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xc86deac208337503 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579889.021734:0:6703:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff8fae4150fa00/0xc86deac2083374fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc86deac208337503 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579889.021838:0:6703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7f5bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:6703:1874413262739712:0@lo:501: 00000100:00100000:0.0:1787579889.021865:0:6703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579889.021896:0:6703:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae5233c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787579889.021956:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262739712 00000100:00100000:3.0:1787579889.021961:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262739712 00000100:00100000:3.0:1787579889.021994:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787579889.022001:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+10:6703:x1874413262739712:12345-0@lo:501: 00000100:00100000:3.0:1787579889.022228:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+10:6703:x1874413262739712:12345-0@lo:501: Request processed in 227us (362us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787579889.022236:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787579889.022322:0:6703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7f5bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:6703:1874413262739712:0@lo:501: 10000000:01000000:0.0:1787579889.022334:0:6703:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.136@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787579889.022356:0:6703:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.136@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787579889.022361:0:6703:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae4150fa00/0xc86deac2083374fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc86deac208337503 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579889.022369:0:6703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae4150fa00/0xc86deac2083374fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc86deac208337503 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579889.022417:0:6703:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.136@tcp lock: ffff8fae4150fa00/0xc86deac2083374fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc86deac208337503 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579889.022434:0:6703:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787579889.022452:0:6703:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8fae50613000 10000000:01000000:0.0:1787579889.022456:0:6703:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787579889.022460:0:6703:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8fae503119b8 10000000:01000000:0.0:1787579889.022462:0:6703:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1787579889.022466:0:6703:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8fae503119b8 from 1 10000000:01000000:0.0:1787579889.022468:0:6703:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1787579889.022488:0:6703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae50feba00/0xc86deac20833750a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579889.022495:0:6703:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff8fae50feba00/0xc86deac20833750a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579889.022503:0:6703:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff8fae50feba00/0xc86deac20833750a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579889.022912:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787579889.022919:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.136@tcp lock: ffff8fae4150fa00/0xc86deac2083374fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xc86deac208337503 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579889.022926:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae4150fa00 already unused, calling callback (ffffffffc1b77c20) 10000000:00010000:3.0:1787579889.022930:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.136@tcp lock: ffff8fae4150fa00/0xc86deac2083374fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xc86deac208337503 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579889.022938:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: ffff8fae4150fa00/0xc86deac2083374fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xc86deac208337503 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787579889.022945:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: ffff8fae4150fa00/0xc86deac2083374fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xc86deac208337503 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787579889.022950:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787579889.022970:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.136@tcp lock: ffff8fae4150fa00/0xc86deac2083374fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xc86deac208337503 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579889.022987:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787579889.023011:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.136@tcp lock: ffff8fae4150fa00/0xc86deac2083374fc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xc86deac208337503 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579889.023018:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: ffff8fae4150fa00/0xc86deac2083374fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xc86deac208337503 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579889.023034:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579889.023036:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579889.023038:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787579889.023091:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5f4ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3315:1874413262739968:0@lo:103: 00000100:00100000:0.0:1787579889.023130:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579889.023187:0:6703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7f5bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:6703:1874413262739840:0@lo:101: 00000100:00100000:0.0:1787579889.023211:0:6703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579889.023222:0:6703:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae5233c180 going to sleep for 11 seconds 00000100:00100000:3.0:1787579889.023278:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262739968 00000100:00100000:3.0:1787579889.023283:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262739968 00000100:00100000:3.0:1787579889.023352:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787579889.023360:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7f5b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+10:3315:x1874413262739968:12345-0@lo:103: 00010000:00010000:3.0:1787579889.023371:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787579889.023427:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fae4ca58000/0xc86deac208337503 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc86deac2083374fc expref: 10 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579889.023441:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787579889.023470:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7f5b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+9:3315:x1874413262739968:12345-0@lo:103: Request processed in 111us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579889.023478:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787579889.023499:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262739840 00000100:00100000:3.0:1787579889.023501:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262739840 00000100:00100000:0.0:1787579889.023796:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5f4ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3315:1874413262739968:0@lo:103: 00000100:00100000:3.0:1787579889.023866:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787579889.023874:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+9:6703:x1874413262739840:12345-0@lo:101: 00010000:00010000:3.0:1787579889.023886:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787579889.023901:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fae4150e800/0xc86deac208337511 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc86deac20833750a expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579889.023945:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fae4150e800/0xc86deac208337511 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc86deac20833750a expref: 10 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579889.023956:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fae4150e800/0xc86deac208337511 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac20833750a expref: 10 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579889.023964:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae4150e800, rc 0) 00000100:00100000:3.0:1787579889.023995:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+10:6703:x1874413262739840:12345-0@lo:101: Request processed in 122us (782us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579889.024000:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787579889.024318:0:6703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7f5bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:6703:1874413262739840:0@lo:101: 00010000:00010000:0.0:1787579889.024332:0:6703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff8fae50feba00/0xc86deac20833750a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208337511 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579889.024347:0:6703:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff8fae50feba00/0xc86deac20833750a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc86deac208337511 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787579889.024364:0:6703:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1787579889.024405:0:6703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae50feba00/0xc86deac20833750a lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208337511 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579889.024422:0:6703:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff8fae50feba00/0xc86deac20833750a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208337511 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787579889.024429:0:6703:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1787579889.024434:0:6703:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787579889.024440:0:6703:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1787579889.024443:0:6703:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787579889.024460:0:6703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae50feb200/0xc86deac208337518 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579889.024466:0:6703:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff8fae50feb200/0xc86deac208337518 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579889.024473:0:6703:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff8fae50feb200/0xc86deac208337518 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579889.024485:0:6703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7f5bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:6703:1874413262740096:0@lo:101: 00000100:00100000:0.0:1787579889.024883:0:6703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579889.024911:0:6703:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae5233c180 going to sleep for 11 seconds 00000100:00100000:3.0:1787579889.025008:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262740096 00000100:00100000:3.0:1787579889.025013:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262740096 00000100:00100000:3.0:1787579889.025038:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787579889.025044:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+10:6703:x1874413262740096:12345-0@lo:101: 00010000:00010000:3.0:1787579889.025052:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787579889.025062:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fae4150fc00/0xc86deac20833751f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc86deac208337518 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579889.025078:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fae4150fc00/0xc86deac20833751f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc86deac208337518 expref: 11 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579889.025086:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fae4150fc00/0xc86deac20833751f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac208337518 expref: 11 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579889.025093:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae4150fc00, rc 0) 00000100:00100000:3.0:1787579889.025120:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+11:6703:x1874413262740096:12345-0@lo:101: Request processed in 76us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579889.025126:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787579889.025203:0:6703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7f5bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:6703:1874413262740096:0@lo:101: 00010000:00010000:0.0:1787579889.025213:0:6703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff8fae50feb200/0xc86deac208337518 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac20833751f expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579889.025225:0:6703:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff8fae50feb200/0xc86deac208337518 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc86deac20833751f expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579889.025970:0:6703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7f5bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:6703:1874413262740224:0@lo:501: 00000100:00100000:0.0:1787579889.026005:0:6703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579889.026041:0:6703:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae5233c180 going to sleep for 11 seconds 00000100:00100000:1.0:1787579889.026455:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262740224 00000100:00100000:1.0:1787579889.026461:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262740224 00000100:00100000:1.0:1787579889.026502:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787579889.026519:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+11:6703:x1874413262740224:12345-0@lo:501: 00000100:00100000:1.0:1787579889.026806:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+11:6703:x1874413262740224:12345-0@lo:501: Request processed in 288us (798us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579889.026813:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787579889.027053:0:6703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7f5bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:6703:1874413262740224:0@lo:501: 00000100:00100000:2.0:1787579889.027088:0:6703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae74638a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:6703:1874413262740352:0@lo:503: 00000100:00100000:2.0:1787579889.027125:0:6703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579889.027155:0:6703:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae4570c180 going to sleep for 11 seconds 00000100:00100000:3.0:1787579889.028191:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262740352 00000100:00100000:3.0:1787579889.028200:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262740352 00000100:00100000:3.0:1787579889.028233:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787579889.028241:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+11:6703:x1874413262740352:12345-0@lo:503: 00000100:00100000:3.0:1787579889.028468:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+11:6703:x1874413262740352:12345-0@lo:503: Request processed in 227us (1341us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579889.028487:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787579889.029135:0:6703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae74638a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:6703:1874413262740352:0@lo:503: 00000040:00080000:2.0:1787579889.029499:0:6703:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787579889.029904:0:6703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae74638a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:6703:1874413262740480:0@lo:502: 00000100:00100000:2.0:1787579889.029959:0:6703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579889.030000:0:6703:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae4570c180 going to sleep for 11 seconds 00000100:00100000:3.0:1787579889.030099:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262740480 00000100:00100000:3.0:1787579889.030105:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262740480 00000100:00100000:3.0:1787579889.030136:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787579889.030144:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+11:6703:x1874413262740480:12345-0@lo:502: 00000100:00100000:3.0:1787579889.030322:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+11:6703:x1874413262740480:12345-0@lo:502: Request processed in 178us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579889.030330:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787579889.035148:0:6703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae74638a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:6703:1874413262740480:0@lo:502: 00000040:00080000:2.0:1787579889.040006:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1787579889.040104:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1787579889.040140:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1787579889.040219:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1787579889.040261:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1787579889.040297:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1787579889.044838:0:6703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae74638a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:6703:1874413262740608:0@lo:502: 00000100:00100000:2.0:1787579889.044943:0:6703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579889.044989:0:6703:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae4570c180 going to sleep for 11 seconds 00000100:00100000:3.0:1787579889.045330:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262740608 00000100:00100000:3.0:1787579889.045338:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262740608 00000100:00100000:3.0:1787579889.045415:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787579889.045426:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+11:6703:x1874413262740608:12345-0@lo:502: 00000100:00100000:3.0:1787579889.045692:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+11:6703:x1874413262740608:12345-0@lo:502: Request processed in 267us (749us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579889.045700:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787579889.047795:0:6703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae74638a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:6703:1874413262740608:0@lo:502: 00000040:00080000:2.0:1787579889.047989:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1787579889.048006:0:6703:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:0.0:1787579889.055909:0:6722:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787579889.055920:0:6722:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1787579889.055926:0:6722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787579889.055928:0:6722:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1787579889.055933:0:6722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787579889.055950:0:6722:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8fae74deb370) 00000020:00000080:0.0:1787579889.055973:0:6722:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787579889.055979:0:6722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787579889.056058:0:6722:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8fae50613000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1787579889.056065:0:6722:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787579889.056071:0:6722:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc86deac20833752d 00010000:00010000:1.0:1787579889.092205:0:6722:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:0.0:1787579889.103286:0:6722:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:0.0:1787579889.106441:0:6722:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1787579889.111999:0:6722:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1787579889.148345:0:6722:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1787579889.149040:0:6722:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:2.0:1787579889.149798:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787579889.152110:0:6722:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1787579889.152122:0:6722:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787579889.152128:0:6722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787579889.152130:0:6722:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1787579889.152134:0:6722:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787579889.152144:0:6722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787579889.152145:0:6722:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787579889.152148:0:6722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787579889.152151:0:6722:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787579889.152213:0:6722:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787579889.152217:0:6722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787579889.152219:0:6722:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787579889.152222:0:6722:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1787579889.152486:0:6703:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:2.0:1787579889.152508:0:6703:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787579889.152526:0:6703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae50feb200/0xc86deac208337518 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac20833751f expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579889.152538:0:6703:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff8fae50feb200/0xc86deac208337518 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac20833751f expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787579889.152547:0:6703:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8fae50613000 from 1 10000000:01000000:2.0:1787579889.152549:0:6703:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787579889.152600:0:6703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae41661600/0xc86deac208337534 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579889.152608:0:6703:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff8fae41661600/0xc86deac208337534 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579889.152619:0:6703:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff8fae41661600/0xc86deac208337534 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579889.152642:0:6703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae74638a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:6703:1874413262740736:0@lo:101: 00000100:00100000:2.0:1787579889.152712:0:6703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579889.152782:0:6703:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae4570c000 going to sleep for 11 seconds 00000100:00100000:1.0:1787579889.152900:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262740736 00000100:00100000:1.0:1787579889.152908:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262740736 00000100:00100000:1.0:1787579889.152958:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787579889.152968:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+11:6703:x1874413262740736:12345-0@lo:101: 00010000:00010000:1.0:1787579889.152981:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787579889.152994:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fae4ca59e00/0xc86deac20833753b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc86deac208337534 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579889.153021:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fae4ca59e00/0xc86deac20833753b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc86deac208337534 expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579889.153031:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fae4ca59e00/0xc86deac20833753b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac208337534 expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579889.153039:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae4ca59e00, rc 0) 00000100:00100000:1.0:1787579889.153087:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+12:6703:x1874413262740736:12345-0@lo:101: Request processed in 120us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579889.153093:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787579889.153148:0:6703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae74638a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:6703:1874413262740736:0@lo:101: 00010000:00010000:1.0:1787579889.153170:0:6703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff8fae41661600/0xc86deac208337534 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac20833753b expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579889.153179:0:6703:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff8fae41661600/0xc86deac208337534 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc86deac20833753b expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579889.153266:0:6703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae48c90e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:6703:1874413262740864:0@lo:501: 00000100:00100000:1.0:1787579889.153290:0:6703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579889.153303:0:6703:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae48da33c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787579889.157821:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262740864 00000100:00100000:3.0:1787579889.157836:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262740864 00000100:00100000:3.0:1787579889.157890:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787579889.157902:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+12:6703:x1874413262740864:12345-0@lo:501: 00000100:00100000:3.0:1787579889.158249:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+12:6703:x1874413262740864:12345-0@lo:501: Request processed in 350us (4956us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579889.158258:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787579889.158572:0:6703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae48c90e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:6703:1874413262740864:0@lo:501: 00000100:00100000:1.0:1787579889.158633:0:6703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae48c90e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:6703:1874413262740992:0@lo:503: 00000100:00100000:1.0:1787579889.158681:0:6703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579889.158715:0:6703:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae48da33c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787579889.158734:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262740992 00000100:00100000:1.0:1787579889.158738:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262740992 00000100:00100000:1.0:1787579889.158782:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787579889.158792:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+12:6703:x1874413262740992:12345-0@lo:503: 00000100:00100000:1.0:1787579889.159016:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+12:6703:x1874413262740992:12345-0@lo:503: Request processed in 226us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579889.159023:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787579889.159074:0:6703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae48c90e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:6703:1874413262740992:0@lo:503: 00000040:00080000:1.0:1787579889.159338:0:6703:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787579889.159442:0:6703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae48c90e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:6703:1874413262741120:0@lo:502: 00000100:00100000:1.0:1787579889.159476:0:6703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579889.159494:0:6703:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae48da33c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787579889.159508:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262741120 00000100:00100000:1.0:1787579889.159518:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262741120 00000100:00100000:1.0:1787579889.159537:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787579889.159543:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+12:6703:x1874413262741120:12345-0@lo:502: 00000100:00100000:1.0:1787579889.159684:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+12:6703:x1874413262741120:12345-0@lo:502: Request processed in 140us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579889.159691:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787579889.159723:0:6703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae48c90e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:6703:1874413262741120:0@lo:502: 00000040:00080000:1.0:1787579889.159939:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1787579889.159985:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1787579889.160005:0:6703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae48c90e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:6703:1874413262741248:0@lo:502: 00000100:00100000:1.0:1787579889.160035:0:6703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579889.160050:0:6703:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae49ef16c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787579889.160063:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262741248 00000100:00100000:1.0:1787579889.160066:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262741248 00000100:00100000:1.0:1787579889.160084:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787579889.160090:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+12:6703:x1874413262741248:12345-0@lo:502: 00000100:00100000:1.0:1787579889.160195:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+12:6703:x1874413262741248:12345-0@lo:502: Request processed in 105us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579889.160202:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787579889.160236:0:6703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae48c90e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:6703:1874413262741248:0@lo:502: 00000040:00080000:1.0:1787579889.160301:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1787579889.160311:0:6703:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1787579889.160653:0:6726:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787579889.160663:0:6726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787579889.160665:0:6726:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787579889.160671:0:6726:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8fae50613000 00000020:00000080:1.0:1787579889.160673:0:6726:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787579889.160700:0:6726:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787579889.160704:0:6726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787579889.160705:0:6726:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1787579889.160707:0:6726:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1787579889.160735:0:6703:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1787579889.160749:0:6703:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787579889.160763:0:6703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae41661600/0xc86deac208337534 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac20833753b expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579889.160772:0:6703:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff8fae41661600/0xc86deac208337534 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac20833753b expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787579889.160808:0:6703:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787579889.160811:0:6703:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8fae50613000 10000000:01000000:1.0:1787579889.160814:0:6703:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8fae50613000 10000000:01000000:1.0:1787579889.160817:0:6703:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787579889.160822:0:6703:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8fae50613000 from 1 10000000:01000000:1.0:1787579889.160825:0:6703:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787579889.160849:0:6703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae4ca58a00/0xc86deac208337542 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579889.160857:0:6703:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff8fae4ca58a00/0xc86deac208337542 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579889.160866:0:6703:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff8fae4ca58a00/0xc86deac208337542 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579889.160879:0:6703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae48c90e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:6703:1874413262741376:0@lo:101: 00000100:00100000:1.0:1787579889.160907:0:6703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579889.160922:0:6703:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae48da33c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787579889.160935:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262741376 00000100:00100000:1.0:1787579889.160944:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262741376 00000100:00100000:1.0:1787579889.160962:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787579889.160969:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+12:6703:x1874413262741376:12345-0@lo:101: 00010000:00010000:1.0:1787579889.160978:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787579889.160988:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fae4ca58000/0xc86deac208337549 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc86deac208337542 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579889.161008:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fae4ca58000/0xc86deac208337549 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc86deac208337542 expref: 13 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579889.161017:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fae4ca58000/0xc86deac208337549 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac208337542 expref: 13 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579889.161025:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae4ca58000, rc 0) 00000100:00100000:1.0:1787579889.161052:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+13:6703:x1874413262741376:12345-0@lo:101: Request processed in 83us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579889.161058:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787579889.161088:0:6703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae48c90e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:6703:1874413262741376:0@lo:101: 00010000:00010000:1.0:1787579889.161101:0:6703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff8fae4ca58a00/0xc86deac208337542 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208337549 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579889.161110:0:6703:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff8fae4ca58a00/0xc86deac208337542 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc86deac208337549 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579889.161166:0:6703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae48c90e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:6703:1874413262741504:0@lo:501: 00000100:00100000:1.0:1787579889.161189:0:6703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579889.161202:0:6703:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae48da33c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787579889.161215:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262741504 00000100:00100000:1.0:1787579889.161218:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262741504 00000100:00100000:1.0:1787579889.161240:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787579889.161246:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+13:6703:x1874413262741504:12345-0@lo:501: 00000100:00100000:1.0:1787579889.161453:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+13:6703:x1874413262741504:12345-0@lo:501: Request processed in 205us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579889.161460:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787579889.161488:0:6703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae48c90e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:6703:1874413262741504:0@lo:501: 00000100:00100000:1.0:1787579889.161510:0:6703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae48c90e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:6703:1874413262741632:0@lo:503: 00000100:00100000:1.0:1787579889.161545:0:6703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579889.161558:0:6703:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae49ef1540 going to sleep for 11 seconds 00000100:00100000:1.0:1787579889.161568:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262741632 00000100:00100000:1.0:1787579889.161571:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262741632 00000100:00100000:2.0:1787579889.161757:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787579889.161771:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+13:6703:x1874413262741632:12345-0@lo:503: 00000100:00100000:2.0:1787579889.162038:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+13:6703:x1874413262741632:12345-0@lo:503: Request processed in 268us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579889.162045:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787579889.163306:0:6703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae48c90e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:6703:1874413262741632:0@lo:503: 00000040:00080000:2.0:1787579889.163675:0:6703:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787579889.163760:0:6703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7463ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:6703:1874413262741760:0@lo:502: 00000100:00100000:2.0:1787579889.163818:0:6703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579889.163854:0:6703:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae4570cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1787579889.165190:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262741760 00000100:00100000:3.0:1787579889.165201:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262741760 00000100:00100000:3.0:1787579889.165254:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787579889.165264:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+13:6703:x1874413262741760:12345-0@lo:502: 00000100:00100000:3.0:1787579889.165608:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+13:6703:x1874413262741760:12345-0@lo:502: Request processed in 343us (1788us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579889.165615:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787579889.165785:0:6703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7463ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:6703:1874413262741760:0@lo:502: 00000040:00080000:2.0:1787579889.166167:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1787579889.166221:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1787579889.166253:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1787579889.166296:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1787579889.166334:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1787579889.166412:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1787579889.166464:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1787579889.166502:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1787579889.166551:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1787579889.166936:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1787579889.166979:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1787579889.167043:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1787579889.167434:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1787579889.167471:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1787579889.167523:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1787579889.167560:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1787579889.167678:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1787579889.167733:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1787579889.167843:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1787579889.167890:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1787579889.167940:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1787579889.167977:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1787579889.168029:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1787579889.170440:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1787579889.170508:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1787579889.170540:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1787579889.170601:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1787579889.170637:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:3.0:1787579889.170690:0:6703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5f4afb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:6703:1874413262741888:0@lo:502: 00000100:00100000:3.0:1787579889.170910:0:6703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579889.170952:0:6703:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae5f8ada80 going to sleep for 11 seconds 00000100:00100000:2.0:1787579889.176216:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262741888 00000100:00100000:2.0:1787579889.176234:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262741888 00000100:00100000:2.0:1787579889.176312:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787579889.176325:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+13:6703:x1874413262741888:12345-0@lo:502: 00000100:00100000:0.0:1787579889.176864:0:6703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5f4afb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:6703:1874413262741888:0@lo:502: 00000040:00080000:0.0:1787579889.176987:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1787579889.177006:0:6703:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000100:00100000:2.0:1787579889.177216:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+13:6703:x1874413262741888:12345-0@lo:502: Request processed in 894us (6305us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579889.177225:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000020:01000004:3.0:1787579889.192323:0:6727:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1787579889.192343:0:6727:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8fae6d540000) 00000020:00000080:3.0:1787579889.192366:0:6727:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:3.0:1787579889.192490:0:6727:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8fae50613000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787579889.192495:0:6727:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8fae50613000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787579889.192498:0:6727:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8fae50613000 3 00010000:00080000:3.0:1787579889.192529:0:6727:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8fae5068b000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.136@tcp at head 00010000:00010000:3.0:1787579889.195568:0:6727:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:3.0:1787579889.196009:0:6727:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1787579889.196224:0:6727:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787579889.196237:0:6727:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xc86deac208337557 00000100:00080000:3.0:1787579889.196247:0:6727:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787579889.196253:0:6727:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8fae5068b000 using connection 192.168.202.136@tcp/0@lo 00000100:00100000:3.0:1787579889.196287:0:6727:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fae5f4aca80 x1874413262742016/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787579889.196358:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5f4aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3313:1874413262742016:0@lo:38: 00000100:00100000:2.0:1787579889.196482:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787579889.196566:0:6727:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787579889.196646:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262742016 00000100:00100000:1.0:1787579889.196654:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262742016 00000100:00100000:1.0:1787579889.196691:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787579889.196700:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7463ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3313:x1874413262742016:12345-0@lo:38: 00010000:00080000:1.0:1787579889.196725:0:5854:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 236 last 0 00000020:00000080:1.0:1787579889.196784:0:5854:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xc86deac20833755e 00000004:00100000:1.0:1787579889.196800:0:5854:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787579889.196828:0:5854:0:(import.c:65:import_set_state_nolock()) ffff8fae77935000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787579889.202167:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7463ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874413262742016:12345-0@lo:38: Request processed in 5438us (5655us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579889.202186:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787579889.203519:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fae5f4aca80 x1874413262742016/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787579899 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787579889.203534:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787579889.203544:0:3313:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1787579889.203553:0:3313:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787579889.203558:0:3313:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787579889.203562:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8fae5068b000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787579889.203569:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5f4aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3313:1874413262742016:0@lo:38: 00000040:00080000:2.0:1787579889.205576:0:6727:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:0.0:1787579889.205921:0:6703:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1787579889.205951:0:6703:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787579889.205972:0:6703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae4ca58a00/0xc86deac208337542 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208337549 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579889.205996:0:6703:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff8fae4ca58a00/0xc86deac208337542 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208337549 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787579889.206046:0:6703:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787579889.206048:0:6703:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787579889.206049:0:6703:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787579889.206050:0:6703:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787579889.206052:0:6703:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787579889.206053:0:6703:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787579889.206054:0:6703:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787579889.206056:0:6703:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787579889.206057:0:6703:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787579889.206059:0:6703:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787579889.206061:0:6703:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787579889.206065:0:6703:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1787579889.206067:0:6703:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787579889.206068:0:6703:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787579889.206069:0:6703:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787579889.206070:0:6703:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787579889.206071:0:6703:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787579889.206072:0:6703:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787579889.206073:0:6703:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787579889.206074:0:6703:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787579889.206075:0:6703:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787579889.206076:0:6703:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787579889.206077:0:6703:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787579889.206102:0:6703:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787579889.206120:0:6703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7f5bad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:6703:1874413262742144:0@lo:253: 00000100:00100000:0.0:1787579889.206191:0:6703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579889.206228:0:6703:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae6d791300 going to sleep for 11 seconds 00000100:00100000:1.0:1787579889.206659:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262742144 00000100:00100000:1.0:1787579889.206668:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262742144 00000100:00100000:1.0:1787579889.207136:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787579889.207148:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+13:6703:x1874413262742144:12345-0@lo:253: 20000000:01000000:1.0:1787579889.207177:0:5845:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787579889.207203:0:5845:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787579889.259718:0:5845:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787579889.259771:0:5845:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1787579889.262445:0:5868:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787579889.262460:0:5868:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787579889.262501:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8fae4150fa00/0xc86deac208337565 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579889.262527:0:5868:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fae4ca58200/0xc86deac2083374c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac2083374bd expref: 13 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579889.262537:0:5868:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8fae4150fa00/0xc86deac208337565 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579889.262605:0:5868:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fae4ca58200/0xc86deac2083374c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc86deac2083374bd expref: 13 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579889.262622:0:5868:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fae4ca58200/0xc86deac2083374c4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc86deac2083374bd expref: 13 pid: 5848 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579889.262660:0:5868:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5f4af800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5868:1874413262742272:0@lo:104: 00000100:00100000:3.0:1787579889.262751:0:5868:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579889.262814:0:5868:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fad418ef180 going to sleep for 11 seconds 00000100:00100000:2.0:1787579889.262981:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262742272 00000100:00100000:2.0:1787579889.262990:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262742272 00000100:00100000:2.0:1787579889.263054:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787579889.263064:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5f4af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+3:5868:x1874413262742272:12345-0@lo:104: 00010000:00010000:2.0:1787579889.263086:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.136@tcp lock: ffff8fae4150fe00/0xc86deac2083374bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc86deac2083374c4 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579889.263159:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787579889.263166:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5f4af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+3:5868:x1874413262742272:12345-0@lo:104: Request processed in 103us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579889.263174:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1787579889.263199:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787579889.263205:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.136@tcp lock: ffff8fae4150fe00/0xc86deac2083374bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc86deac2083374c4 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579889.263214:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae4150fe00 already unused, calling callback (ffffffffc1b77c20) 10000000:00010000:2.0:1787579889.263219:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.136@tcp lock: ffff8fae4150fe00/0xc86deac2083374bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc86deac2083374c4 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579889.263240:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: ffff8fae4150fe00/0xc86deac2083374bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc86deac2083374c4 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787579889.263248:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: ffff8fae4150fe00/0xc86deac2083374bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc86deac2083374c4 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787579889.263255:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787579889.263288:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.136@tcp lock: ffff8fae4150fe00/0xc86deac2083374bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac2083374c4 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579889.263295:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787579889.263313:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.136@tcp lock: ffff8fae4150fe00/0xc86deac2083374bd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac2083374c4 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579889.263320:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: ffff8fae4150fe00/0xc86deac2083374bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac2083374c4 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579889.263347:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579889.263349:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579889.263351:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787579889.263374:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7463a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3316:1874413262742400:0@lo:103: 00000100:00100000:2.0:1787579889.263467:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579889.263864:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262742400 00000100:00100000:0.0:1787579889.263870:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262742400 00010000:00010000:0.0:1787579889.263898:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fae4ca58200/0xc86deac2083374c4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc86deac2083374bd expref: 14 pid: 5848 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579889.263951:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787579889.263957:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae52134050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+14:3316:x1874413262742400:12345-0@lo:103: 00010000:00010000:0.0:1787579889.263972:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787579889.263977:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fae4ca58200/0xc86deac2083374c4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc86deac2083374bd expref: 14 pid: 5848 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579889.263989:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fae4ca58200/0xc86deac2083374c4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc86deac2083374bd expref: 14 pid: 5848 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579889.264009:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8fae4150fa00/0xc86deac208337565 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579889.264018:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fae4150fa00/0xc86deac208337565 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787579889.264035:0:5839:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002121421s 00010000:00010000:0.0:1787579889.264039:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fae4150fa00/0xc86deac208337565 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579889.264047:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fae4150fa00/0xc86deac208337565 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579889.264055:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8fae4150fa00/0xc86deac208337565 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579889.264062:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8fae4150fa00/0xc86deac208337565 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579889.264067:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae4150fa00 already unused, calling callback (ffffffffc155a230) 00010000:00010000:0.0:1787579889.264072:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8fae4150fa00/0xc86deac208337565 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579889.264085:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8fae4150fa00/0xc86deac208337565 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579889.264096:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8fae4150fa00/0xc86deac208337565 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579889.264106:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787579889.264153:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae52134050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+14:3316:x1874413262742400:12345-0@lo:103: Request processed in 195us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579889.264161:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787579889.264249:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7463a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3316:1874413262742400:0@lo:103: 00010000:00010000:0.0:1787579889.264284:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fae4ca58200/0xc86deac2083374c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc86deac2083374bd expref: 13 pid: 5848 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579889.264298:0:5868:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5f4af800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5868:1874413262742272:0@lo:104: 00010000:00010000:0.0:1787579889.264313:0:5868:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8fae4150fa00/0xc86deac208337565 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579889.264323:0:5868:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8fae4150fa00/0xc86deac208337565 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579889.264330:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8fae4150fa00/0xc86deac208337565 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579889.264336:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fae4150fa00/0xc86deac208337565 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579889.283969:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+12:6703:x1874413262742144:12345-0@lo:253: Request processed in 76803us (77757us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579889.283996:0:6703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7f5bad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:6703:1874413262742144:0@lo:253: 00000100:00100000:0.0:1787579889.284019:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 10000000:01000000:1.0:1787579889.284024:0:6703:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787579889.284029:0:6703:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787579889.284031:0:6703:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787579889.284033:0:6703:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787579889.284034:0:6703:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787579889.284036:0:6703:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787579889.284037:0:6703:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787579889.284039:0:6703:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787579889.284041:0:6703:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787579889.284044:0:6703:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787579889.284046:0:6703:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787579889.284047:0:6703:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787579889.284068:0:6703:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1787579889.291137:0:6703:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1787579889.291325:0:6703:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1787579889.292034:0:6703:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1787579889.292232:0:6703:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787579889.293744:0:6703:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1787579889.294255:0:6703:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1787579889.296106:0:6703:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 10000000:01000000:2.0:1787579889.499530:0:5850:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787579889.499540:0:5850:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8fae6a238800 from 21 10000000:01000000:2.0:1787579889.499545:0:5850:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787579889.499617:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae41661200/0xc86deac20833756c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579889.499632:0:5850:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff8fae41661200/0xc86deac20833756c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579889.499646:0:5850:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff8fae41661200/0xc86deac20833756c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579889.499679:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae74639c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262742528:0@lo:101: 00000100:00100000:2.0:1787579889.499776:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579889.500644:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262742528 00000100:00100000:3.0:1787579889.500656:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262742528 00000100:00100000:2.0:1787579889.500739:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae4570cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1787579889.501145:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787579889.501159:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae487de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+12:5850:x1874413262742528:12345-0@lo:101: 00010000:00010000:3.0:1787579889.501183:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787579889.501207:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fae4150ee00/0xc86deac208337573 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc86deac20833756c expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579889.501244:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fae4150ee00/0xc86deac208337573 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc86deac20833756c expref: 13 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579889.501255:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fae4150ee00/0xc86deac208337573 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac20833756c expref: 13 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579889.501266:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae4150ee00, rc 0) 00000100:00100000:3.0:1787579889.501343:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae487de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+13:5850:x1874413262742528:12345-0@lo:101: Request processed in 186us (1566us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579889.501351:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787579889.501606:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae74639c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262742528:0@lo:101: 00010000:00010000:2.0:1787579889.501631:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff8fae41661200/0xc86deac20833756c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208337573 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579889.501642:0:5850:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff8fae41661200/0xc86deac20833756c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc86deac208337573 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579889.501737:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae74639c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262742656:0@lo:501: 00000100:00100000:2.0:1787579889.501938:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579889.501967:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae4570cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1787579889.502049:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262742656 00000100:00100000:0.0:1787579889.502055:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262742656 00000100:00100000:0.0:1787579889.502096:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787579889.502105:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae487df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+13:5850:x1874413262742656:12345-0@lo:501: 00000100:00100000:0.0:1787579889.502536:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae487df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+13:5850:x1874413262742656:12345-0@lo:501: Request processed in 431us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579889.502545:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787579889.502716:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae74639c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262742656:0@lo:501: 00000100:00100000:2.0:1787579889.502763:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae74639c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262742784:0@lo:503: 00000100:00100000:2.0:1787579889.502812:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579889.502850:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae4570cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1787579889.502910:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262742784 00000100:00100000:3.0:1787579889.502917:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262742784 00000100:00100000:3.0:1787579889.502959:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787579889.502967:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae487dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+13:5850:x1874413262742784:12345-0@lo:503: 00000100:00100000:3.0:1787579889.503217:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae487dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+13:5850:x1874413262742784:12345-0@lo:503: Request processed in 250us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579889.503226:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787579889.503305:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae74639c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262742784:0@lo:503: 00000100:00100000:2.0:1787579889.504000:0:6731:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae74639c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:6731:1874413262742912:0@lo:502: 00000100:00100000:2.0:1787579889.504052:0:6731:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579889.504087:0:6731:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae4570c000 going to sleep for 11 seconds 00000100:00100000:3.0:1787579889.504145:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262742912 00000100:00100000:3.0:1787579889.504151:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262742912 00000100:00100000:3.0:1787579889.504193:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787579889.504201:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae487ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+13:6731:x1874413262742912:12345-0@lo:502: 00000100:00100000:0.0:1787579889.504990:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae487ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+13:6731:x1874413262742912:12345-0@lo:502: Request processed in 784us (933us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579889.505002:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787579889.505120:0:6731:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae74639c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:6731:1874413262742912:0@lo:502: 00000100:00100000:2.0:1787579889.505190:0:6731:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae74639c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:6731:1874413262743040:0@lo:502: 00000100:00100000:2.0:1787579889.505234:0:6731:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579889.505271:0:6731:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae4570c000 going to sleep for 11 seconds 00000100:00100000:0.0:1787579889.505334:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262743040 00000100:00100000:0.0:1787579889.505341:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262743040 00000100:00100000:0.0:1787579889.505518:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787579889.505528:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae487df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+13:6731:x1874413262743040:12345-0@lo:502: 00000100:00100000:0.0:1787579889.505758:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae487df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+13:6731:x1874413262743040:12345-0@lo:502: Request processed in 231us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579889.505766:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787579889.505914:0:6731:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae74639c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:6731:1874413262743040:0@lo:502: 00000040:00080000:3.0:1787579889.505939:0:6731:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1787579889.506154:0:5850:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1787579889.506175:0:5850:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787579889.506189:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae41661200/0xc86deac20833756c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208337573 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579889.506202:0:5850:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff8fae41661200/0xc86deac20833756c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208337573 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787579889.506213:0:5850:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787579889.506216:0:5850:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8fae6a238800 from 4 10000000:01000000:1.0:1787579889.506219:0:5850:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787579889.506261:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae4ca59800/0xc86deac20833757a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579889.506287:0:5850:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff8fae4ca59800/0xc86deac20833757a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579889.506298:0:5850:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff8fae4ca59800/0xc86deac20833757a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579889.506316:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae48c92300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262743168:0@lo:101: 00000100:00100000:1.0:1787579889.506356:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579889.506731:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae436f8d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787579889.506791:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262743168 00000100:00100000:2.0:1787579889.506946:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262743168 00000100:00100000:2.0:1787579889.511871:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787579889.511890:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae487dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+13:5850:x1874413262743168:12345-0@lo:101: 00010000:00010000:2.0:1787579889.511918:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787579889.511947:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fae41661a00/0xc86deac208337581 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc86deac20833757a expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579889.511984:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fae41661a00/0xc86deac208337581 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc86deac20833757a expref: 14 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579889.511996:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fae41661a00/0xc86deac208337581 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac20833757a expref: 14 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579889.512025:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae41661a00, rc 0) 00000100:00100000:2.0:1787579889.512148:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae487dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+14:5850:x1874413262743168:12345-0@lo:101: Request processed in 263us (5790us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579889.512156:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787579889.512232:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae48c92300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262743168:0@lo:101: 00010000:00010000:2.0:1787579889.512255:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff8fae4ca59800/0xc86deac20833757a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208337581 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579889.512267:0:5850:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff8fae4ca59800/0xc86deac20833757a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc86deac208337581 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579889.512347:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae74639f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262743296:0@lo:256: 00000100:00100000:2.0:1787579889.512430:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579889.512463:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae4570c840 going to sleep for 11 seconds 00000100:00100000:2.0:1787579889.512477:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262743296 00000100:00100000:2.0:1787579889.512484:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262743296 00000100:00100000:2.0:1787579889.512506:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787579889.512511:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae487dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+14:5850:x1874413262743296:12345-0@lo:256: 20000000:01000000:2.0:1787579889.512529:0:5848:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787579889.512547:0:5848:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787579889.512550:0:5848:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1787579889.512646:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae487dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+14:5850:x1874413262743296:12345-0@lo:256: Request processed in 134us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579889.512653:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787579889.512681:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae74639f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262743296:0@lo:256: 10000000:01000000:2.0:1787579889.512725:0:5850:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787579889.512737:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae4ca59800/0xc86deac20833757a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208337581 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579889.512746:0:5850:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff8fae4ca59800/0xc86deac20833757a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208337581 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787579889.512755:0:5850:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1787579889.512758:0:5850:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1787579889.512761:0:5850:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787579889.512783:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae41660e00/0xc86deac208337588 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579889.512789:0:5850:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff8fae41660e00/0xc86deac208337588 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579889.512798:0:5850:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff8fae41660e00/0xc86deac208337588 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579889.512809:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae74639f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262743424:0@lo:101: 00000100:00100000:2.0:1787579889.512836:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579889.512856:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae4570c840 going to sleep for 11 seconds 00000100:00100000:2.0:1787579889.512868:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262743424 00000100:00100000:2.0:1787579889.512873:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262743424 00000100:00100000:2.0:1787579889.512890:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787579889.512895:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae487dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+14:5850:x1874413262743424:12345-0@lo:101: 00010000:00010000:2.0:1787579889.512903:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787579889.512914:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fae41660a00/0xc86deac20833758f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc86deac208337588 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579889.512930:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fae41660a00/0xc86deac20833758f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc86deac208337588 expref: 15 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579889.512946:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fae41660a00/0xc86deac20833758f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac208337588 expref: 15 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579889.512954:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae41660a00, rc 0) 00000100:00100000:2.0:1787579889.512982:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae487dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+15:5850:x1874413262743424:12345-0@lo:101: Request processed in 86us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579889.512987:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787579889.513013:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae74639f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262743424:0@lo:101: 00010000:00010000:2.0:1787579889.513024:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff8fae41660e00/0xc86deac208337588 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac20833758f expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579889.513032:0:5850:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff8fae41660e00/0xc86deac208337588 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc86deac20833758f expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579889.513088:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae74639f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262743552:0@lo:501: 00000100:00100000:2.0:1787579889.513110:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579889.513120:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae4570c840 going to sleep for 11 seconds 00000100:00100000:2.0:1787579889.513131:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262743552 00000100:00100000:2.0:1787579889.513134:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262743552 00000100:00100000:2.0:1787579889.513147:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787579889.513152:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae487dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+15:5850:x1874413262743552:12345-0@lo:501: 00000100:00100000:2.0:1787579889.513492:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae487dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+15:5850:x1874413262743552:12345-0@lo:501: Request processed in 338us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579889.513500:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787579889.513530:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae74639f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262743552:0@lo:501: 00000100:00100000:2.0:1787579889.513560:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae74639f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262743680:0@lo:503: 00000100:00100000:2.0:1787579889.513621:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579889.513635:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae51e92f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787579889.513650:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262743680 00000100:00100000:2.0:1787579889.513654:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262743680 00000100:00100000:2.0:1787579889.513673:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787579889.513679:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae487dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+15:5850:x1874413262743680:12345-0@lo:503: 00000100:00100000:2.0:1787579889.514001:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae487dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+15:5850:x1874413262743680:12345-0@lo:503: Request processed in 321us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579889.514008:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787579889.514047:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae74639f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262743680:0@lo:503: 00000100:00100000:1.0:1787579889.515094:0:6732:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae48c91c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:6732:1874413262743808:0@lo:502: 00000100:00100000:1.0:1787579889.515179:0:6732:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579889.515224:0:6732:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae436f8900 going to sleep for 11 seconds 00000100:00100000:2.0:1787579889.515295:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262743808 00000100:00100000:2.0:1787579889.515304:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262743808 00000100:00100000:2.0:1787579889.515353:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787579889.515364:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae52127450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+15:6732:x1874413262743808:12345-0@lo:502: 00000100:00100000:3.0:1787579889.517810:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae52127450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+15:6732:x1874413262743808:12345-0@lo:502: Request processed in 2434us (2618us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579889.517827:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787579889.517936:0:6732:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae48c91c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:6732:1874413262743808:0@lo:502: 00000020:01000000:3.0:1787579889.517980:0:6732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787579889.517990:0:6732:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1787579889.517998:0:6732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787579889.518002:0:6732:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1787579889.518008:0:6732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787579889.518012:0:6732:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.136@tcp to nid 0x20000c0a8ca88 (192.168.202.136@tcp) 00000020:01000000:3.0:1787579889.518043:0:6732:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787579889.518045:0:6732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787579889.518066:0:6732:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8fae6d544d28) 00000020:00000080:3.0:1787579889.518094:0:6732:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1787579889.518100:0:6732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787579889.518230:0:6732:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1787579889.518238:0:6732:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:3.0:1787579889.518247:0:6732:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc86deac20833759d 00010000:00080000:3.0:1787579889.518298:0:6732:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8fad42b64000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.136@tcp at head 00010000:00010000:3.0:1787579889.518626:0:6732:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00002000:00080000:2.0:1787579889.565248:0:6703:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1787579889.565255:0:6703:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1787579889.565301:0:6703:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787579889.565365:0:6703:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.136@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787579889.565415:0:6703:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1787579889.565447:0:6703:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00000040:01000000:3.0:1787579889.598907:0:6732:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1787579889.598947:0:6732:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1787579889.599534:0:6732:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787579889.599719:0:6732:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787579889.599771:0:6732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1787579889.599833:0:6732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1787579889.601170:0:6734:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787579889.601178:0:6734:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1787579889.606995:0:6732:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787579889.607020:0:6732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787579889.607079:0:6732:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1787579889.607138:0:6732:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc86deac2083375a4 00000100:00080000:0.0:1787579889.607153:0:6732:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787579889.607160:0:6732:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8fad42b64000 using connection 192.168.202.136@tcp/0@lo 00000100:00100000:0.0:1787579889.607284:0:6732:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fae7f5b9180 x1874413262743936/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787579889.607377:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7f5b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1874413262743936:0@lo:8: 00000100:00100000:2.0:1787579889.607492:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787579889.607595:0:6732:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1787579889.607667:0:6732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787579889.607673:0:6732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787579889.607675:0:6732:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1787579889.607679:0:6732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787579889.607684:0:6732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787579889.607686:0:6732:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787579889.607689:0:6732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787579889.607691:0:6732:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787579889.607799:0:6732:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7f5ba680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:6732:1874413262744064:0@lo:502: 00000100:00100000:0.0:1787579889.607851:0:6732:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579889.607875:0:6732:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae6d791300 going to sleep for 11 seconds 00000100:00100000:3.0:1787579889.608026:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262744064 00000100:00100000:3.0:1787579889.608034:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262744064 00000100:00100000:3.0:1787579889.608088:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787579889.608100:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae52126850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+15:6732:x1874413262744064:12345-0@lo:502: 00000100:00100000:3.0:1787579889.608408:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae52126850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+15:6732:x1874413262744064:12345-0@lo:502: Request processed in 286us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579889.608417:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787579889.608457:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787579889.608467:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5f4aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1874413262744320:0@lo:400: 00000100:00100000:3.0:1787579889.608498:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579889.608544:0:6732:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7f5ba680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:6732:1874413262744064:0@lo:502: 00000020:01000000:3.0:1787579889.608572:0:6732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787579889.608577:0:6732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787579889.608594:0:6732:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787579889.608601:0:6732:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000100:00100000:0.0:1787579889.609461:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787579889.609475:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5f4ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874413262744192:0@lo:400: 00000100:00100000:0.0:1787579889.609520:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579889.609870:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262744320 00000100:00100000:3.0:1787579889.609877:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262744320 00000100:00100000:3.0:1787579889.609940:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262744192 00000100:00100000:3.0:1787579889.609944:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262744192 00000100:00100000:3.0:1787579889.609964:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787579889.609973:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5f4ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874413262744320:12345-0@lo:400: 00000100:00100000:3.0:1787579889.610023:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5f4ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874413262744320:12345-0@lo:400: Request processed in 51us (1524us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579889.610043:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787579889.610061:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787579889.610067:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7f5b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874413262744192:12345-0@lo:400: 00000100:00100000:3.0:1787579889.610103:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7f5b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874413262744192:12345-0@lo:400: Request processed in 36us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579889.610110:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1787579889.610147:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fae5f4aed80 x1874413262744320/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787579905 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787579889.610161:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5f4aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1874413262744320:0@lo:400: 00010000:00080000:3.0:1787579889.610188:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fae5f4ad180 x1874413262744192/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787579905 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787579889.610411:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5f4ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874413262744192:0@lo:400: 00000100:00100000:2.0:1787579889.610873:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262743936 00000100:00100000:2.0:1787579889.610880:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262743936 00000100:00100000:2.0:1787579889.611004:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787579889.611012:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74639f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3313:x1874413262743936:12345-0@lo:8: 00010000:00080000:2.0:1787579889.611048:0:6705:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 237 last 0 00000020:00000080:2.0:1787579889.611078:0:6705:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc86deac2083375ab 00002000:00100000:2.0:1787579889.611127:0:6705:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8fad411c2800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113950 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1787579889.611133:0:6705:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:2.0:1787579889.611137:0:6705:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1787579889.611284:0:6705:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787579889.611491:0:6705:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787579889.611519:0:6705:0:(import.c:65:import_set_state_nolock()) ffff8fad411c3000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787579889.611596:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74639f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3313:x1874413262743936:12345-0@lo:8: Request processed in 571us (4091us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579889.611604:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000020:01000000:2.0:1787579889.612162:0:5850:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:2.0:1787579889.612187:0:5850:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787579889.612197:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae41660e00/0xc86deac208337588 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac20833758f expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579889.612209:0:5850:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff8fae41660e00/0xc86deac208337588 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac20833758f expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787579889.612221:0:5850:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1787579889.612224:0:5850:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8fae503119b8 from 1 10000000:01000000:2.0:1787579889.612227:0:5850:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787579889.612257:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae41660200/0xc86deac2083375b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579889.612265:0:5850:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff8fae41660200/0xc86deac2083375b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579889.612275:0:5850:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff8fae41660200/0xc86deac2083375b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579889.612298:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7463aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262744448:0@lo:101: 00000100:00100000:2.0:1787579889.612335:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579889.612419:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae5f8ad600 going to sleep for 11 seconds 00000100:00080000:2.0:1787579889.612432:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787579889.612458:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fae7f5b9180 x1874413262743936/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787579899 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787579889.612469:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787579889.612477:0:3313:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1787579889.612484:0:3313:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787579889.612489:0:3313:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1787579889.612492:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8fad42b64000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787579889.612503:0:3313:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787579889.612508:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7f5b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1874413262743936:0@lo:8: 00000004:00080000:2.0:1787579889.613300:0:6734:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787579889.613458:0:6734:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 237369074245ns, next at 0ns, rc = 0 00000100:00100000:3.0:1787579889.626418:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262744448 00000100:00100000:3.0:1787579889.626437:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262744448 00000100:00100000:3.0:1787579889.626501:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787579889.626513:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+15:5850:x1874413262744448:12345-0@lo:101: 00010000:00010000:3.0:1787579889.628253:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787579889.628275:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fae4150f600/0xc86deac2083375b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc86deac2083375b2 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579889.628308:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fae4150f600/0xc86deac2083375b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc86deac2083375b2 expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579889.628320:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fae4150f600/0xc86deac2083375b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac2083375b2 expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579889.628342:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae4150f600, rc 0) 00000100:00100000:3.0:1787579889.628451:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+16:5850:x1874413262744448:12345-0@lo:101: Request processed in 1939us (16113us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579889.628459:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787579889.630326:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7463aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262744448:0@lo:101: 00010000:00010000:2.0:1787579889.630358:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff8fae41660200/0xc86deac2083375b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac2083375b9 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579889.630369:0:5850:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff8fae41660200/0xc86deac2083375b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc86deac2083375b9 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579889.630487:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7463aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262744576:0@lo:501: 00000100:00100000:2.0:1787579889.630622:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579889.630665:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae5f8ad600 going to sleep for 11 seconds 00000100:00100000:2.0:1787579889.630705:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262744576 00000100:00100000:2.0:1787579889.630785:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262744576 00000100:00100000:2.0:1787579889.630834:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787579889.630843:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+16:5850:x1874413262744576:12345-0@lo:501: 00000100:00100000:2.0:1787579889.631301:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+16:5850:x1874413262744576:12345-0@lo:501: Request processed in 457us (677us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787579889.631309:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787579889.632308:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7463aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262744576:0@lo:501: 10000000:01000000:2.0:1787579889.632342:0:5850:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787579889.632351:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae41660200/0xc86deac2083375b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac2083375b9 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579889.632362:0:5850:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff8fae41660200/0xc86deac2083375b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac2083375b9 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787579889.684860:0:6735:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1787579889.684902:0:6735:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7f5baa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6735:1874413262744832:0@lo:7: 00000100:00100000:0.0:1787579889.685133:0:6735:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579889.685187:0:6735:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae48da33c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787579889.687195:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787579889.687218:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7f5b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874413262744704:0@lo:13: 00000100:00100000:2.0:1787579889.687276:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579889.687344:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262744704 00000100:00100000:2.0:1787579889.687352:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262744704 00000100:00100000:2.0:1787579889.687436:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787579889.687448:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7463aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1874413262744704:12345-0@lo:13: 00002000:00000024:2.0:1787579889.687475:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3861905408 avail 3859808256 00000100:00100000:2.0:1787579889.688824:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7463aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1874413262744704:12345-0@lo:13: Request processed in 1374us (1543us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579889.688836:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1787579889.688871:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787579889.688912:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fae7f5b9f80 x1874413262744704/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787579905 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787579889.688945:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7f5b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874413262744704:0@lo:13: 00000100:00100000:3.0:1787579889.694990:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262744832 00000100:00100000:3.0:1787579889.695010:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262744832 00000100:00100000:3.0:1787579889.695082:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787579889.695096:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7f5ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6735:x1874413262744832:12345-0@lo:7: 00002000:00080000:3.0:1787579889.735243:0:6708:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1787579889.735254:0:6708:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1787579889.735375:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7f5ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6735:x1874413262744832:12345-0@lo:7: Request processed in 40278us (50238us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579889.737461:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787579889.737551:0:6735:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fae7f5baa00 x1874413262744832/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787579905 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787579889.737569:0:6735:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7f5baa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6735:1874413262744832:0@lo:7: 00000004:00080000:3.0:1787579889.737593:0:6735:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1787579889.737640:0:6735:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5f4ad180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6735:1874413262744960:0@lo:5: 00000100:00100000:3.0:1787579889.737700:0:6735:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579889.737910:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262744960 00000100:00100000:2.0:1787579889.737919:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262744960 00000100:00100000:2.0:1787579889.737963:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787579889.737971:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5f4aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6735:x1874413262744960:12345-0@lo:5: 00002000:00080000:2.0:1787579889.737999:0:6705:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1787579889.738004:0:6705:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1787579889.738440:0:6735:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fad418ef0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787579889.741907:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5f4aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:6735:x1874413262744960:12345-0@lo:5: Request processed in 3927us (4198us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1787579889.741922:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787579889.741980:0:6735:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fae5f4ad180 x1874413262744960/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787579905 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787579889.742001:0:6735:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5f4ad180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6735:1874413262744960:0@lo:5: 00000004:00080000:2.0:1787579889.742016:0:6735:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1787579889.742059:0:6735:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae74639c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6735:1874413262745088:0@lo:700: 00000100:00100000:2.0:1787579889.742100:0:6735:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579889.742122:0:6735:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae51e92e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787579889.746943:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262745088 00000100:00100000:2.0:1787579889.746966:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262745088 00000100:00100000:2.0:1787579889.747039:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787579889.747052:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7463a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6735:x1874413262745088:12345-0@lo:700: 00000100:00100000:2.0:1787579889.747135:0:6714:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae74639880 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6714:1874413262745216:0@lo:700: 00000100:00100000:2.0:1787579889.747244:0:6714:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579889.747287:0:6714:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae51e92f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787579889.747314:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262745216 00000100:00100000:2.0:1787579889.747329:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262745216 00000100:00100000:2.0:1787579889.747362:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787579889.747369:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7463b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6714:x1874413262745216:12345-0@lo:700: 00000004:00080000:0.0:1787579889.783245:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 40000000:02000000:2.0:1787579889.905605:0:5859:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:2.0:1787579889.933133:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7463b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6714:x1874413262745216:12345-0@lo:700: Request processed in 185756us (185880us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579889.933150:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787579889.933234:0:6714:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fae74639880 x1874413262745216/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787579905 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787579889.933249:0:6714:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae74639880 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6714:1874413262745216:0@lo:700: 40000000:02000000:2.0:1787579889.933263:0:6714:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00010000:00010000:2.0:1787579890.174035:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787579890.212768:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7463a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6735:x1874413262745088:12345-0@lo:700: Request processed in 465708us (470656us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579890.212783:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000001:00080000:0.0:1787579890.216902:0:6733:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:0.0:1787579890.216919:0:6733:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:3.0:1787579890.218647:0:6735:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fae74639c00 x1874413262745088/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787579905 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787579890.218666:0:6735:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae74639c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6735:1874413262745088:0@lo:700: 00000004:02000040:3.0:1787579890.307432:0:6735:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:3.0:1787579890.314258:0:6735:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5f4adc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6735:1874413262745344:0@lo:5: 00000100:00100000:3.0:1787579890.314351:0:6735:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579890.314622:0:6735:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fad418ef840 going to sleep for 11 seconds 00000100:00100000:3.0:1787579890.314651:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262745344 00000100:00100000:3.0:1787579890.314659:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262745344 00000100:00100000:3.0:1787579890.314772:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787579890.314785:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5f4adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6735:x1874413262745344:12345-0@lo:5: 00002000:00080000:2.0:1787579890.322371:0:6708:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1787579890.322594:0:6708:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:2.0:1787579890.344747:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5f4adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6735:x1874413262745344:12345-0@lo:5: Request processed in 29954us (30385us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1787579890.344761:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787579890.346077:0:6735:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fae5f4adc00 x1874413262745344/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787579906 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787579890.346094:0:6735:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1787579890.346110:0:6735:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8fae5f4adc00 x1874413262745344/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787579906 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787579890.346121:0:6735:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5f4adc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6735:1874413262745344:0@lo:5: 00000004:00080000:3.0:1787579890.346134:0:6735:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:3.0:1787579891.188579:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579892.219965:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579893.235621:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579894.262301:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787579894.899606:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5f4aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874413262745600:0@lo:400: 00000100:00100000:3.0:1787579894.899689:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579894.899755:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787579894.899761:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5f4ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3317:1874413262745472:0@lo:400: 00000100:00100000:3.0:1787579894.899792:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579894.899837:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5f4ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874413262745728:0@lo:400: 00000100:00100000:3.0:1787579894.899865:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579894.899879:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5f4ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874413262745856:0@lo:400: 00000100:00100000:3.0:1787579894.899902:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262745600 00000100:00100000:3.0:1787579894.899910:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262745600 00000100:00100000:0.0:1787579894.899922:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579894.899958:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262745728 00000100:00100000:3.0:1787579894.899962:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262745728 00000100:00100000:0.0:1787579894.899972:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262745856 00000100:00100000:0.0:1787579894.899978:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262745856 00000100:00100000:3.0:1787579894.899995:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787579894.900019:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787579894.900022:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5f4af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874413262745600:12345-0@lo:400: 00000100:00100000:0.0:1787579894.900032:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7f5b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3315:x1874413262745856:12345-0@lo:400: 00000100:00100000:3.0:1787579894.900088:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5f4af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874413262745600:12345-0@lo:400: Request processed in 68us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579894.900095:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7f5b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3315:x1874413262745856:12345-0@lo:400: Request processed in 67us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579894.900097:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787579894.900108:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787579894.900121:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787579894.900131:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5f4ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874413262745728:12345-0@lo:400: 00010000:00080000:0.0:1787579894.900155:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fae5f4ac700 x1874413262745856/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787579910 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787579894.900168:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5f4ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874413262745728:12345-0@lo:400: Request processed in 38us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579894.900173:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5f4ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874413262745856:0@lo:400: 00000100:00100000:3.0:1787579894.900180:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787579894.900203:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262745472 00000100:00100000:3.0:1787579894.900207:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262745472 00000100:00100000:3.0:1787579894.900233:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787579894.900240:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+16:3317:x1874413262745472:12345-0@lo:400: 00000100:00100000:3.0:1787579894.900269:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+16:3317:x1874413262745472:12345-0@lo:400: Request processed in 29us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579894.900274:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:3.0:1787579894.900302:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787579894.900308:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787579894.900329:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fae5f4ae300 x1874413262745728/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787579910 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787579894.900339:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5f4ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874413262745728:0@lo:400: 00000100:00100000:3.0:1787579894.900358:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5f4ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3317:1874413262745472:0@lo:400: 00010000:00080000:3.0:1787579894.900367:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fae5f4aea00 x1874413262745600/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787579910 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787579894.900375:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5f4aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874413262745600:0@lo:400: 00000100:00100000:2.0:1787579894.900792:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5f4aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262745984:0@lo:13: 00000100:00100000:2.0:1787579894.900827:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579894.902152:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262745984 00000100:00100000:3.0:1787579894.902163:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262745984 00000100:00100000:3.0:1787579894.902224:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787579894.902234:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74639880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1874413262745984:12345-0@lo:13: 00002000:00000024:3.0:1787579894.902275:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787579894.902344:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74639880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1874413262745984:12345-0@lo:13: Request processed in 112us (1515us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579894.902351:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787579894.903005:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fae5f4aea00 x1874413262745984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787579910 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787579894.903028:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5f4aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262745984:0@lo:13: 00010000:00010000:3.0:1787579895.283710:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787579895.590136:0:6733:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:2.0:1787579896.309574:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579897.333695:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579898.361842:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787579899.170252:0:7076:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg236-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787579899.380735:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787579900.021682:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5f4ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3317:1874413262746112:0@lo:400: 00000100:00100000:1.0:1787579900.021716:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5f4afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262746496:0@lo:400: 00000100:00100000:2.0:1787579900.022981:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5f4ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874413262746240:0@lo:400: 00000100:00100000:1.0:1787579900.024935:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579900.025137:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787579900.025148:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae48c90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262746624:0@lo:13: 00000100:00100000:1.0:1787579900.025181:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579900.025220:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262746624 00000100:00100000:1.0:1787579900.025229:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262746624 00000100:00100000:1.0:1787579900.025296:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787579900.025307:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262746624:12345-0@lo:13: 00002000:00000024:1.0:1787579900.025364:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787579900.025435:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262746624:12345-0@lo:13: Request processed in 129us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579900.025444:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1787579900.025465:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787579900.025508:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fae48c90380 x1874413262746624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787579916 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787579900.025519:0:3316:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1787579900.025747:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae48c90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262746624:0@lo:13: 00000100:00100000:3.0:1787579900.031851:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579900.031910:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262746112 00000100:00100000:1.0:1787579900.031922:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262746112 00000100:00100000:1.0:1787579900.031980:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787579900.031991:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+16:3317:x1874413262746112:12345-0@lo:400: 00000100:00100000:2.0:1787579900.032145:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579900.032198:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787579900.032211:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5f4aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874413262746368:0@lo:400: 00000100:00100000:2.0:1787579900.032265:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579900.032303:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262746496 00000100:00100000:2.0:1787579900.032307:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262746496 00000100:00100000:2.0:1787579900.032340:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787579900.032348:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262746496:12345-0@lo:400: 00000100:00100000:2.0:1787579900.032415:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262746496:12345-0@lo:400: Request processed in 67us (7489us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579900.032423:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787579900.033008:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262746240 00000100:00100000:2.0:1787579900.033014:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262746240 00000100:00100000:2.0:1787579900.033043:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262746368 00000100:00100000:2.0:1787579900.033046:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262746368 00000100:00100000:2.0:1787579900.033070:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787579900.033079:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74639180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874413262746240:12345-0@lo:400: 00000100:00100000:2.0:1787579900.033128:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74639180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874413262746240:12345-0@lo:400: Request processed in 50us (982us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579900.033135:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787579900.033148:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787579900.033154:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7463b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874413262746368:12345-0@lo:400: 00000100:00100000:2.0:1787579900.033181:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7463b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874413262746368:12345-0@lo:400: Request processed in 28us (915us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579900.033187:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1787579900.033235:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fae5f4aca80 x1874413262746368/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787579916 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787579900.033253:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5f4aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874413262746368:0@lo:400: 00010000:00080000:2.0:1787579900.033279:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fae5f4ae300 x1874413262746240/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787579916 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787579900.033288:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5f4ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874413262746240:0@lo:400: 00000100:00100000:1.0:1787579900.038191:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+16:3317:x1874413262746112:12345-0@lo:400: Request processed in 6189us (6548us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579900.038207:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:1.0:1787579900.038416:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787579900.038471:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fae5f4afb80 x1874413262746496/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787579916 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787579900.038497:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5f4afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262746496:0@lo:400: 00000100:00100000:3.0:1787579900.046143:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5f4ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3317:1874413262746112:0@lo:400: 00010000:00010000:3.0:1787579900.404582:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787579901.427721:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579902.451640:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579903.475772:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579904.499655:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787579905.140876:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5f4ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3314:1874413262746752:0@lo:400: 00000100:00100000:1.0:1787579905.140959:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579905.141342:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262746752 00000100:00100000:3.0:1787579905.141351:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262746752 00000100:00100000:3.0:1787579905.141428:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787579905.141440:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5ba0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+16:3314:x1874413262746752:12345-0@lo:400: 00000100:00100000:3.0:1787579905.141743:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5ba0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+16:3314:x1874413262746752:12345-0@lo:400: Request processed in 304us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579905.141754:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787579905.141994:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5f4ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874413262747008:0@lo:400: 00000100:00100000:3.0:1787579905.142042:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579905.142067:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787579905.142072:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5f4af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874413262747136:0@lo:400: 00000100:00100000:3.0:1787579905.142091:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579905.144477:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5f4ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3314:1874413262746752:0@lo:400: 00000100:00100000:2.0:1787579905.144485:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262747008 00000100:00100000:2.0:1787579905.144494:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262747008 00000100:00100000:1.0:1787579905.144519:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5f4ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874413262747264:0@lo:400: 00000100:00100000:2.0:1787579905.144546:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262747136 00000100:00100000:2.0:1787579905.144550:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262747136 00000100:00100000:2.0:1787579905.144585:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787579905.144590:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579905.144600:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5f4ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874413262747008:12345-0@lo:400: 00000100:00100000:1.0:1787579905.144638:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787579905.144647:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7f5b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874413262746880:0@lo:13: 00000100:00100000:2.0:1787579905.144672:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5f4ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874413262747008:12345-0@lo:400: Request processed in 75us (2628us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579905.144679:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579905.144684:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787579905.144705:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787579905.144713:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5f4afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874413262747136:12345-0@lo:400: 00000100:00100000:2.0:1787579905.144747:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5f4afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874413262747136:12345-0@lo:400: Request processed in 36us (2655us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579905.144754:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1787579905.144802:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787579905.144839:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fae5f4af480 x1874413262747136/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787579921 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787579905.144852:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5f4af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874413262747136:0@lo:400: 00010000:00080000:2.0:1787579905.144863:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fae5f4ad500 x1874413262747008/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787579921 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787579905.144870:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5f4ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874413262747008:0@lo:400: 00000100:00100000:1.0:1787579905.145226:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262746880 00000100:00100000:1.0:1787579905.145231:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262746880 00000100:00100000:1.0:1787579905.145351:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787579905.145359:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874413262746880:12345-0@lo:13: 00002000:00000024:1.0:1787579905.145479:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787579905.145568:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874413262746880:12345-0@lo:13: Request processed in 210us (889us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579905.145575:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787579905.145671:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fae7f5b8e00 x1874413262746880/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787579921 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787579905.145688:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7f5b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874413262746880:0@lo:13: 00000100:00100000:0.0:1787579905.146060:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262747264 00000100:00100000:0.0:1787579905.146074:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262747264 00000100:00100000:0.0:1787579905.146114:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787579905.146122:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874413262747264:12345-0@lo:400: 00000100:00100000:0.0:1787579905.146178:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874413262747264:12345-0@lo:400: Request processed in 58us (1592us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579905.146186:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787579905.146217:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fae5f4ac000 x1874413262747264/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787579921 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787579905.146228:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5f4ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874413262747264:0@lo:400: 00000100:00080000:2.0:1787579905.148221:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787579905.523590:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579906.550044:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579907.575474:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787579908.598292:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579909.619788:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787579910.261996:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae74638000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874413262747520:0@lo:400: 00000100:00100000:3.0:1787579910.262104:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae74638a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3315:1874413262747392:0@lo:400: 00000100:00100000:3.0:1787579910.262170:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579910.262214:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787579910.262218:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae74638700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874413262747776:0@lo:400: 00000100:00100000:3.0:1787579910.262248:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579910.262347:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262747392 00000100:00100000:1.0:1787579910.262355:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262747392 00000100:00100000:1.0:1787579910.262442:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787579910.262452:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5ba0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+16:3315:x1874413262747392:12345-0@lo:400: 00000100:00100000:1.0:1787579910.262527:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5ba0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+16:3315:x1874413262747392:12345-0@lo:400: Request processed in 76us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579910.262534:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787579910.262586:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae74638a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3315:1874413262747392:0@lo:400: 00000100:00100000:2.0:1787579910.262708:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579910.262739:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787579910.262745:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae74638380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874413262747648:0@lo:400: 00000100:00100000:2.0:1787579910.262768:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579910.262798:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262747776 00000100:00100000:2.0:1787579910.262802:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262747776 00000100:00100000:2.0:1787579910.262841:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787579910.262849:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5f4ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1874413262747776:12345-0@lo:400: 00000100:00100000:2.0:1787579910.262887:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5f4ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1874413262747776:12345-0@lo:400: Request processed in 39us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579910.262894:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787579910.262913:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262747520 00000100:00100000:2.0:1787579910.262917:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262747520 00000100:00100000:2.0:1787579910.262936:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262747648 00000100:00100000:2.0:1787579910.262939:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262747648 00000100:00100000:2.0:1787579910.262954:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787579910.262960:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7463a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874413262747520:12345-0@lo:400: 00000100:00100000:2.0:1787579910.262994:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7463a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874413262747520:12345-0@lo:400: Request processed in 34us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579910.263001:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787579910.263073:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787579910.263080:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74638a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874413262747648:12345-0@lo:400: 00000100:00100000:2.0:1787579910.263101:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74638a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874413262747648:12345-0@lo:400: Request processed in 23us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579910.263105:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1787579910.263118:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787579910.263131:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787579910.263149:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fae74638380 x1874413262747648/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787579926 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787579910.263158:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae74638380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874413262747648:0@lo:400: 00010000:00080000:2.0:1787579910.263164:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fae74638000 x1874413262747520/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787579926 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787579910.263169:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae74638000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874413262747520:0@lo:400: 00000100:00100000:2.0:1787579910.263326:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787579910.263334:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7f5b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874413262747904:0@lo:13: 00000100:00100000:2.0:1787579910.263356:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579910.263459:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262747904 00000100:00100000:0.0:1787579910.263464:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262747904 00000100:00100000:0.0:1787579910.265505:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1787579910.266215:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fae74638700 x1874413262747776/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787579926 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787579910.266236:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae74638700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874413262747776:0@lo:400: 00000100:00100000:0.0:1787579910.266742:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74638000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874413262747904:12345-0@lo:13: 00002000:00000024:0.0:1787579910.266788:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787579910.266938:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74638000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874413262747904:12345-0@lo:13: Request processed in 556us (3578us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579910.266947:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1787579910.267079:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fae7f5b8000 x1874413262747904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787579926 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787579910.267103:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7f5b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874413262747904:0@lo:13: 00010000:00010000:2.0:1787579910.647977:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579911.668455:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787579912.396822:0:7636:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787579912.396826:0:7636:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1787579912.399274:0:7636:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8fae77937800 00000020:01000004:2.0:1787579912.399299:0:7636:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1787579912.399312:0:7636:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1787579912.399329:0:7636:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8fae5217b370) 00000020:00000080:2.0:1787579912.399359:0:7636:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787579912.461220:0:7636:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1787579912.461524:0:7636:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1787579912.535025:0:7636:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1787579912.549086:0:7636:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1787579912.549138:0:7636:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1787579912.549192:0:7636:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1787579912.549220:0:7636:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1787579912.550637:0:7636:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1787579912.550652:0:7636:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787579912.550671:0:7636:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc86deac2083375c7 00000020:01000004:1.0:1787579912.550680:0:7636:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:1.0:1787579912.550707:0:7636:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.136@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1787579912.550711:0:7636:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.136@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1787579912.550718:0:7636:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1787579912.550743:0:7636:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:1.0:1787579912.550748:0:7636:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.136@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1787579912.598352:0:7636:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.136@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787579912.598431:0:7636:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.136@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1787579912.598436:0:7636:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787579912.598438:0:7636:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787579912.598440:0:7636:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787579912.598441:0:7636:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787579912.598446:0:7636:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787579912.598447:0:7636:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787579912.598449:0:7636:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787579912.598450:0:7636:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787579912.598452:0:7636:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787579912.598453:0:7636:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787579912.598454:0:7636:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787579912.598459:0:7636:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1787579912.598462:0:7636:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787579912.598463:0:7636:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787579912.598463:0:7636:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787579912.598464:0:7636:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787579912.598465:0:7636:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787579912.598466:0:7636:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787579912.598467:0:7636:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787579912.598467:0:7636:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787579912.598468:0:7636:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787579912.598469:0:7636:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787579912.598470:0:7636:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787579912.598517:0:7636:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787579912.598544:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae74638380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:7636:1874413262748032:0@lo:253: 00000100:00100000:2.0:1787579912.598621:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579912.598673:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae5dd21300 going to sleep for 11 seconds 00000100:00100000:0.0:1787579912.600554:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262748032 00000100:00100000:0.0:1787579912.600591:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262748032 00000100:00100000:0.0:1787579912.600656:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787579912.600667:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5ba09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+16:7636:x1874413262748032:12345-0@lo:253: 20000000:01000000:0.0:1787579912.600717:0:5845:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1787579912.600722:0:5845:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1787579912.600728:0:5845:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1787579912.600732:0:5845:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1787579912.602012:0:5845:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787579912.602238:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1787579912.602252:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1787579912.602294:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1787579912.602303:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1787579912.602335:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1787579912.602428:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1787579912.602822:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1787579912.602843:0:5845:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.136@tcp 20000000:01000000:0.0:1787579912.602846:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.136@tcp (null) (null) (null) 00000040:00080000:0.0:1787579912.602885:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1787579912.602893:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787579912.602942:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1787579912.602950:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.202.136@tcp (null) (null) 00000040:00080000:0.0:1787579912.602983:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1787579912.602992:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1787579912.603026:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1787579912.603080:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1787579912.606371:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:1.0:1787579912.606455:0:5845:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.136@tcp 20000000:01000000:1.0:1787579912.606458:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.136@tcp (null) (null) (null) 00000040:00080000:1.0:1787579912.606495:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:1.0:1787579912.606504:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1787579912.606550:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:1.0:1787579912.606558:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.202.136@tcp (null) (null) 00000040:00080000:1.0:1787579912.606584:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:1.0:1787579912.606593:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1787579912.606655:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:1.0:1787579912.606691:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:1.0:1787579912.606708:0:5845:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:1.0:1787579912.606711:0:5845:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1787579912.606714:0:5845:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1787579912.606728:0:5845:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787579912.606730:0:5845:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1787579912.606764:0:5845:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787579912.606766:0:5845:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787579912.607566:0:7638:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1787579912.607640:0:7638:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1787579912.607695:0:7638:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1787579912.608624:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1787579912.608668:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1787579912.608732:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:3.0:1787579912.608747:0:5845:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1787579912.608751:0:5845:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787579912.609818:0:7639:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1787579912.610116:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1787579912.610166:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1787579912.610229:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1787579912.610246:0:5845:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787579912.610249:0:5845:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787579912.611166:0:7640:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:2.0:1787579912.611228:0:7640:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:2.0:1787579912.611283:0:7640:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1787579912.612910:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:3.0:1787579912.612967:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:3.0:1787579912.613002:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:3.0:1787579912.613018:0:5845:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1787579912.613022:0:5845:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787579912.618811:0:7641:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:1.0:1787579912.618966:0:7641:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:1.0:1787579912.618999:0:7641:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:3.0:1787579912.620245:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:3.0:1787579912.620321:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:3.0:1787579912.620470:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:3.0:1787579912.620493:0:5845:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:3.0:1787579912.620496:0:5845:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:3.0:1787579912.620508:0:5845:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787579912.620669:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8fae4150fe00/0xc86deac2083375ce lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579912.620687:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fae4150fc00/0xc86deac20833751f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac208337518 expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579912.620694:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fae4ca58000/0xc86deac208337549 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac208337542 expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579912.620701:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fae4150ee00/0xc86deac208337573 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac20833756c expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579912.620707:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fae41660a00/0xc86deac20833758f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac208337588 expref: 16 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579912.620714:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fae4150f600/0xc86deac2083375b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac2083375b2 expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579912.620720:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8fae4150fe00/0xc86deac2083375ce lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579912.620762:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fae4150f600/0xc86deac2083375b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc86deac2083375b2 expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579912.620885:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fae4150f600/0xc86deac2083375b9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc86deac2083375b2 expref: 16 pid: 5847 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579912.620913:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5f4aca80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5845:1874413262748160:0@lo:104: 00000100:00100000:3.0:1787579912.620994:0:5845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787579912.621048:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fae41660a00/0xc86deac20833758f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc86deac208337588 expref: 16 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579912.621057:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fae41660a00/0xc86deac20833758f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc86deac208337588 expref: 16 pid: 5848 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579912.621066:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5f4adc00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5845:1874413262748288:0@lo:104: 00010000:00010000:3.0:1787579912.621092:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fae4150ee00/0xc86deac208337573 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc86deac20833756c expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579912.621100:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fae4150ee00/0xc86deac208337573 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc86deac20833756c expref: 16 pid: 5847 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579912.621107:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5f4aea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5845:1874413262748416:0@lo:104: 00010000:00010000:3.0:1787579912.621132:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fae4ca58000/0xc86deac208337549 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc86deac208337542 expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579912.621140:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fae4ca58000/0xc86deac208337549 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc86deac208337542 expref: 16 pid: 5845 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579912.621149:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5f4ac700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5845:1874413262748544:0@lo:104: 00010000:00010000:3.0:1787579912.621172:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fae4150fc00/0xc86deac20833751f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc86deac208337518 expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579912.621180:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fae4150fc00/0xc86deac20833751f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc86deac208337518 expref: 16 pid: 5847 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579912.621198:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5f4ac000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5845:1874413262748672:0@lo:104: 00000100:00100000:3.0:1787579912.621217:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae4cf6cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787579912.621822:0:5836:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787579912.621851:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579912.621886:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579912.621895:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579912.621904:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579912.621916:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262748160 00000100:00100000:1.0:1787579912.621925:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262748160 00000100:00100000:1.0:1787579912.621963:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262748288 00000100:00100000:1.0:1787579912.621967:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262748288 00000100:00100000:1.0:1787579912.621978:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262748416 00000100:00100000:1.0:1787579912.621980:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262748416 00000100:00100000:1.0:1787579912.621989:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262748544 00000100:00100000:1.0:1787579912.621992:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262748544 00000100:00100000:1.0:1787579912.622000:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262748672 00000100:00100000:1.0:1787579912.622002:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262748672 00000100:00100000:1.0:1787579912.622016:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787579912.622025:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae50776c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+7:5845:x1874413262748160:12345-0@lo:104: 00010000:00010000:1.0:1787579912.622039:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.136@tcp lock: ffff8fae41660200/0xc86deac2083375b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc86deac2083375b9 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579912.622108:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787579912.622114:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae50776c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+7:5845:x1874413262748160:12345-0@lo:104: Request processed in 90us (1120us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579912.622122:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787579912.622168:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787579912.622175:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c93b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+6:5845:x1874413262748288:12345-0@lo:104: 00010000:00010000:1.0:1787579912.622183:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.136@tcp lock: ffff8fae41660e00/0xc86deac208337588 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc86deac20833758f expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579912.622232:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787579912.622236:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c93b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+6:5845:x1874413262748288:12345-0@lo:104: Request processed in 64us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579912.622242:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787579912.622254:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787579912.622260:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c90a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+5:5845:x1874413262748416:12345-0@lo:104: 00010000:00010000:1.0:1787579912.622266:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.136@tcp lock: ffff8fae41661200/0xc86deac20833756c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc86deac208337573 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579912.622289:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787579912.622294:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c90a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+5:5845:x1874413262748416:12345-0@lo:104: Request processed in 35us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579912.622299:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787579912.622309:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787579912.622315:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c93800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+4:5845:x1874413262748544:12345-0@lo:104: 00010000:00010000:1.0:1787579912.622323:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.136@tcp lock: ffff8fae4ca58a00/0xc86deac208337542 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc86deac208337549 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579912.622348:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1787579912.622352:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c93800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+4:5845:x1874413262748544:12345-0@lo:104: Request processed in 38us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579912.622358:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787579912.622370:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787579912.622407:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c93100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+3:5845:x1874413262748672:12345-0@lo:104: 00010000:00010000:1.0:1787579912.622414:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.136@tcp lock: ffff8fae50feb200/0xc86deac208337518 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc86deac20833751f expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579912.622447:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1787579912.622452:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c93100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+3:5845:x1874413262748672:12345-0@lo:104: Request processed in 76us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579912.622458:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1787579912.622473:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1787579912.622478:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.136@tcp lock: ffff8fae41660200/0xc86deac2083375b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc86deac2083375b9 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579912.622486:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae41660200 already unused, calling callback (ffffffffc1b77c20) 10000000:00010000:1.0:1787579912.622490:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.136@tcp lock: ffff8fae41660200/0xc86deac2083375b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xc86deac2083375b9 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579912.622499:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: ffff8fae41660200/0xc86deac2083375b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xc86deac2083375b9 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787579912.622506:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: ffff8fae41660200/0xc86deac2083375b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xc86deac2083375b9 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579912.622672:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1787579912.622832:0:7642:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787579912.622840:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.136@tcp lock: ffff8fae41660e00/0xc86deac208337588 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xc86deac20833758f expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579912.622847:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae41660e00 already unused, calling callback (ffffffffc1b77c20) 10000000:00010000:0.0:1787579912.622855:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.136@tcp lock: ffff8fae41660e00/0xc86deac208337588 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xc86deac20833758f expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579912.622862:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: ffff8fae41660e00/0xc86deac208337588 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xc86deac20833758f expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787579912.622869:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: ffff8fae41660e00/0xc86deac208337588 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xc86deac20833758f expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787579912.622875:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787579912.622905:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.136@tcp lock: ffff8fae41660e00/0xc86deac208337588 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac20833758f expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579912.622912:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787579912.622925:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.136@tcp lock: ffff8fae41660e00/0xc86deac208337588 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac20833758f expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579912.622932:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: ffff8fae41660e00/0xc86deac208337588 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac20833758f expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579912.622946:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787579912.622949:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.136@tcp lock: ffff8fae4ca58a00/0xc86deac208337542 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc86deac208337549 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579912.622954:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae4ca58a00 already unused, calling callback (ffffffffc1b77c20) 10000000:00010000:0.0:1787579912.622957:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.136@tcp lock: ffff8fae4ca58a00/0xc86deac208337542 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xc86deac208337549 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579912.622964:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: ffff8fae4ca58a00/0xc86deac208337542 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xc86deac208337549 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787579912.622982:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: ffff8fae4ca58a00/0xc86deac208337542 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xc86deac208337549 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787579912.622987:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787579912.623001:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.136@tcp lock: ffff8fae4ca58a00/0xc86deac208337542 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac208337549 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579912.623006:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787579912.623011:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.136@tcp lock: ffff8fae4ca58a00/0xc86deac208337542 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac208337549 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579912.623018:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: ffff8fae4ca58a00/0xc86deac208337542 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac208337549 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579912.623026:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787579912.623029:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.136@tcp lock: ffff8fae50feb200/0xc86deac208337518 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc86deac20833751f expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579912.623035:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae50feb200 already unused, calling callback (ffffffffc1b77c20) 10000000:00010000:0.0:1787579912.623038:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.136@tcp lock: ffff8fae50feb200/0xc86deac208337518 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc86deac20833751f expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579912.623044:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: ffff8fae50feb200/0xc86deac208337518 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc86deac20833751f expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787579912.623050:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: ffff8fae50feb200/0xc86deac208337518 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc86deac20833751f expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787579912.623056:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787579912.623071:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.136@tcp lock: ffff8fae50feb200/0xc86deac208337518 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac20833751f expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579912.623077:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787579912.623092:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.136@tcp lock: ffff8fae50feb200/0xc86deac208337518 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac20833751f expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579912.623098:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: ffff8fae50feb200/0xc86deac208337518 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac20833751f expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579912.623108:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787579912.623110:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787579912.623111:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787579912.623239:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7f5b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3316:1874413262748800:0@lo:103: 00000100:00100000:2.0:1787579912.623278:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579912.623328:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787579912.623334:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7f5b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3316:1874413262748928:0@lo:103: 00000100:00100000:2.0:1787579912.623357:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579912.623417:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7f5bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3314:1874413262749056:0@lo:103: 00000100:00100000:2.0:1787579912.623442:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579912.623476:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262748800 00000100:00100000:2.0:1787579912.623481:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262748800 00010000:00010000:2.0:1787579912.623506:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fae41660a00/0xc86deac20833758f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc86deac208337588 expref: 17 pid: 5848 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579912.623534:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262748928 00000100:00100000:2.0:1787579912.623537:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262748928 00010000:00010000:2.0:1787579912.623547:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fae4ca58000/0xc86deac208337549 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc86deac208337542 expref: 18 pid: 5845 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579912.623557:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262749056 00000100:00100000:2.0:1787579912.623559:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262749056 00010000:00010000:2.0:1787579912.623567:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fae4150fc00/0xc86deac20833751f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc86deac208337518 expref: 19 pid: 5847 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579912.623578:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787579912.623584:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74639c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:3316:x1874413262748800:12345-0@lo:103: 00010000:00010000:2.0:1787579912.623594:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787579912.623600:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fae41660a00/0xc86deac20833758f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc86deac208337588 expref: 19 pid: 5848 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579912.623610:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fae41660a00/0xc86deac20833758f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc86deac208337588 expref: 19 pid: 5848 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579912.623630:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787579912.623668:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74639c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:3316:x1874413262748800:12345-0@lo:103: Request processed in 84us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579912.623676:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787579912.623691:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787579912.623697:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7463bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+18:3316:x1874413262748928:12345-0@lo:103: 00010000:00010000:2.0:1787579912.623703:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787579912.623708:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fae4ca58000/0xc86deac208337549 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc86deac208337542 expref: 18 pid: 5845 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579912.623716:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fae4ca58000/0xc86deac208337549 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc86deac208337542 expref: 18 pid: 5845 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579912.623725:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787579912.623743:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7463bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+18:3316:x1874413262748928:12345-0@lo:103: Request processed in 47us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579912.623748:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787579912.623757:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787579912.623763:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74638700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+17:3314:x1874413262749056:12345-0@lo:103: 00010000:00010000:2.0:1787579912.623769:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787579912.623772:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fae4150fc00/0xc86deac20833751f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc86deac208337518 expref: 17 pid: 5847 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579912.623779:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fae4150fc00/0xc86deac20833751f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc86deac208337518 expref: 17 pid: 5847 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579912.623787:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787579912.623811:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74638700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+17:3314:x1874413262749056:12345-0@lo:103: Request processed in 48us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579912.623816:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787579912.623865:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7f5bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3314:1874413262749056:0@lo:103: 00000100:00100000:2.0:1787579912.623887:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7f5b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3316:1874413262748928:0@lo:103: 00000100:00100000:2.0:1787579912.623894:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7f5b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3316:1874413262748800:0@lo:103: 00000100:00100000:3.0:1787579912.624031:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5f4aca80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5845:1874413262748160:0@lo:104: 00010000:00010000:3.0:1787579912.624042:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fae41660a00/0xc86deac20833758f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc86deac208337588 expref: 16 pid: 5848 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579912.624053:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5f4adc00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5845:1874413262748288:0@lo:104: 00000100:00100000:3.0:1787579912.624061:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5f4aea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5845:1874413262748416:0@lo:104: 00010000:00010000:3.0:1787579912.624068:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fae4ca58000/0xc86deac208337549 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc86deac208337542 expref: 15 pid: 5845 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579912.624076:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5f4ac700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5845:1874413262748544:0@lo:104: 00010000:00010000:3.0:1787579912.624084:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fae4150fc00/0xc86deac20833751f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc86deac208337518 expref: 14 pid: 5847 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579912.624092:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5f4ac000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5845:1874413262748672:0@lo:104: 00010000:00010000:3.0:1787579912.624112:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8fae4150fe00/0xc86deac2083375ce lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787579912.624286:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787579912.624320:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.136@tcp lock: ffff8fae41660200/0xc86deac2083375b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac2083375b9 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579912.624327:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787579912.624349:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.136@tcp lock: ffff8fae41660200/0xc86deac2083375b2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac2083375b9 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579912.624356:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: ffff8fae41660200/0xc86deac2083375b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac2083375b9 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579912.624530:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787579912.624540:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae48c92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3314:1874413262749184:0@lo:103: 00000100:00100000:3.0:1787579912.624571:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579912.624604:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262749184 00000100:00100000:3.0:1787579912.624609:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262749184 00010000:00010000:3.0:1787579912.624628:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fae4150f600/0xc86deac2083375b9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc86deac2083375b2 expref: 14 pid: 5847 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579912.624665:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787579912.624672:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5f4ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+14:3314:x1874413262749184:12345-0@lo:103: 00010000:00010000:3.0:1787579912.624696:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787579912.624701:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fae4150f600/0xc86deac2083375b9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc86deac2083375b2 expref: 14 pid: 5847 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579912.624709:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fae4150f600/0xc86deac2083375b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc86deac2083375b2 expref: 14 pid: 5847 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579912.624721:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fae4150f600/0xc86deac2083375b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc86deac2083375b2 expref: 14 pid: 5847 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579912.624731:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787579912.624758:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5f4ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+13:3314:x1874413262749184:12345-0@lo:103: Request processed in 87us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579912.624765:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787579912.624809:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae48c92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3314:1874413262749184:0@lo:103: 00010000:00010000:1.0:1787579912.625083:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787579912.625086:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787579912.625088:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787579912.626158:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787579912.626162:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787579912.626165:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579912.626204:0:7642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.136@tcp lock: ffff8fae41661200/0xc86deac20833756c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc86deac208337573 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579912.626215:0:7642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae41661200 already unused, calling callback (ffffffffc1b77c20) 10000000:00010000:3.0:1787579912.626220:0:7642:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.136@tcp lock: ffff8fae41661200/0xc86deac20833756c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc86deac208337573 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579912.626230:0:7642:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: ffff8fae41661200/0xc86deac20833756c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc86deac208337573 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787579912.626237:0:7642:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: ffff8fae41661200/0xc86deac20833756c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc86deac208337573 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787579912.626253:0:7642:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787579912.626662:0:7642:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.136@tcp lock: ffff8fae41661200/0xc86deac20833756c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac208337573 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579912.626670:0:7642:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787579912.626703:0:7642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.136@tcp lock: ffff8fae41661200/0xc86deac20833756c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac208337573 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579912.626711:0:7642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: ffff8fae41661200/0xc86deac20833756c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac208337573 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579912.626728:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579912.626730:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579912.626732:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787579912.626777:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787579912.626795:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5f4ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3317:1874413262749312:0@lo:103: 00000100:00100000:0.0:1787579912.626856:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579912.627178:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262749312 00000100:00100000:3.0:1787579912.627185:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262749312 00010000:00010000:3.0:1787579912.627212:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fae4150ee00/0xc86deac208337573 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc86deac20833756c expref: 13 pid: 5847 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579912.627248:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787579912.627257:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7f5b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+13:3317:x1874413262749312:12345-0@lo:103: 00010000:00010000:3.0:1787579912.627270:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787579912.627276:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fae4150ee00/0xc86deac208337573 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc86deac20833756c expref: 13 pid: 5847 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579912.627286:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fae4150ee00/0xc86deac208337573 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc86deac20833756c expref: 13 pid: 5847 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579912.627310:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fae4150ee00/0xc86deac208337573 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc86deac20833756c expref: 13 pid: 5847 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579912.627337:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8fae4150fe00/0xc86deac2083375ce lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579912.627345:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fae4150fe00/0xc86deac2083375ce lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579912.627362:0:5838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fae4150fe00/0xc86deac2083375ce lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579912.627370:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fae4150fe00/0xc86deac2083375ce lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579912.627412:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8fae4150fe00/0xc86deac2083375ce lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579912.627420:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8fae4150fe00/0xc86deac2083375ce lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579912.627426:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae4150fe00 already unused, calling callback (ffffffffc155a230) 00010000:00010000:3.0:1787579912.627432:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8fae4150fe00/0xc86deac2083375ce lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579912.627441:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8fae4150fe00/0xc86deac2083375ce lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579912.627455:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8fae4150fe00/0xc86deac2083375ce lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579912.627466:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787579912.627505:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7f5b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+12:3317:x1874413262749312:12345-0@lo:103: Request processed in 249us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579912.627537:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1787579912.627565:0:5845:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8fae4150fe00/0xc86deac2083375ce lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579912.627574:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8fae4150fe00/0xc86deac2083375ce lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579912.627581:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fae4150fe00/0xc86deac2083375ce lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787579912.627594:0:5845:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1787579912.627927:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5f4ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3317:1874413262749312:0@lo:103: 00010000:00010000:0.0:1787579912.691551:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787579912.705728:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5ba09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+11:7636:x1874413262748032:12345-0@lo:253: Request processed in 105051us (107095us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579912.705746:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787579912.705983:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae74638380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:7636:1874413262748032:0@lo:253: 10000000:01000000:1.0:1787579912.706012:0:7636:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1787579912.706016:0:7636:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787579912.706194:0:7636:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787579912.706196:0:7636:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787579912.706198:0:7636:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:1.0:1787579912.706199:0:7636:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787579912.706201:0:7636:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787579912.706202:0:7636:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787579912.706204:0:7636:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1787579912.706206:0:7636:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787579912.706207:0:7636:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787579912.706231:0:7636:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8fae77937800 from lustre-OST0001 10000000:01000000:1.0:1787579912.706260:0:7636:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1787579912.706263:0:7636:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787579912.706272:0:7636:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8fae503119b8 local copy 10000000:01000000:1.0:1787579912.706276:0:7636:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787579912.706315:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae4ca58600/0xc86deac2083375d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579912.706327:0:7636:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.136@tcp lock: ffff8fae4ca58600/0xc86deac2083375d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579912.706339:0:7636:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff8fae4ca58600/0xc86deac2083375d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579912.706419:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae48c90700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:7636:1874413262749440:0@lo:101: 00000100:00100000:1.0:1787579912.706464:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579912.706500:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae52111a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787579912.707880:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262749440 00000100:00100000:0.0:1787579912.707894:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262749440 00000100:00100000:0.0:1787579912.707967:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787579912.707979:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5ba09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+11:7636:x1874413262749440:12345-0@lo:101: 00010000:00010000:0.0:1787579912.707995:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787579912.708015:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fae50feb200/0xc86deac2083375dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc86deac2083375d5 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579912.708042:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fae50feb200/0xc86deac2083375dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc86deac2083375d5 expref: 12 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579912.708068:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fae50feb200/0xc86deac2083375dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac2083375d5 expref: 12 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579912.708078:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae50feb200, rc 0) 00000100:00100000:0.0:1787579912.708302:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5ba09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+12:7636:x1874413262749440:12345-0@lo:101: Request processed in 314us (1826us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579912.708310:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787579912.708587:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae48c90700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:7636:1874413262749440:0@lo:101: 00010000:00010000:2.0:1787579912.708604:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff8fae4ca58600/0xc86deac2083375d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xc86deac2083375dc expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579912.708615:0:7636:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff8fae4ca58600/0xc86deac2083375d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc86deac2083375dc expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579912.708786:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae74638380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:7636:1874413262749568:0@lo:501: 00000100:00100000:2.0:1787579912.708827:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579912.708906:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae5dd21d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787579912.708971:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262749568 00000100:00100000:0.0:1787579912.708976:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262749568 00000100:00100000:0.0:1787579912.709010:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787579912.709018:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5ba0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+12:7636:x1874413262749568:12345-0@lo:501: 00000100:00100000:0.0:1787579912.709441:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5ba0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+12:7636:x1874413262749568:12345-0@lo:501: Request processed in 422us (611us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787579912.709450:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787579912.709523:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae74638380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:7636:1874413262749568:0@lo:501: 10000000:01000000:2.0:1787579912.709540:0:7636:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.136@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787579912.709570:0:7636:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.136@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787579912.709576:0:7636:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae4ca58600/0xc86deac2083375d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc86deac2083375dc expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579912.709586:0:7636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae4ca58600/0xc86deac2083375d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc86deac2083375dc expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579912.709593:0:7636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.136@tcp lock: ffff8fae4ca58600/0xc86deac2083375d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc86deac2083375dc expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579912.709618:0:7636:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787579912.709664:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787579912.709671:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.136@tcp lock: ffff8fae4ca58600/0xc86deac2083375d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xc86deac2083375dc expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579912.709679:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae4ca58600 already unused, calling callback (ffffffffc1b77c20) 10000000:00010000:1.0:1787579912.709683:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.136@tcp lock: ffff8fae4ca58600/0xc86deac2083375d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xc86deac2083375dc expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579912.709691:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: ffff8fae4ca58600/0xc86deac2083375d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xc86deac2083375dc expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787579912.709697:0:7636:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8fae77937800 10000000:00010000:1.0:1787579912.709698:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: ffff8fae4ca58600/0xc86deac2083375d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xc86deac2083375dc expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787579912.709702:0:7636:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787579912.709704:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787579912.709707:0:7636:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787579912.709709:0:7636:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787579912.709713:0:7636:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1787579912.709715:0:7636:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1787579912.709724:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.136@tcp lock: ffff8fae4ca58600/0xc86deac2083375d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xc86deac2083375dc expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579912.709729:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787579912.709731:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae41661200/0xc86deac2083375e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579912.709738:0:7636:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff8fae41661200/0xc86deac2083375e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579912.709746:0:7636:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff8fae41661200/0xc86deac2083375e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579912.709764:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae74638380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:7636:1874413262749824:0@lo:101: 00000100:00100000:0.0:1787579912.709791:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae48c90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3317:1874413262749696:0@lo:103: 00000100:00100000:2.0:1787579912.709793:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579912.709819:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579912.709864:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae5dd21cc0 going to sleep for 11 seconds 00010000:00010000:1.0:1787579912.709873:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.136@tcp lock: ffff8fae4ca58600/0xc86deac2083375d5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc86deac2083375dc expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579912.709880:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: ffff8fae4ca58600/0xc86deac2083375d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc86deac2083375dc expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579912.709892:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787579912.709899:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787579912.709902:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787579912.709907:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262749824 00000100:00100000:3.0:1787579912.709912:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262749824 00000100:00100000:3.0:1787579912.709985:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787579912.709994:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5ba0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+12:7636:x1874413262749824:12345-0@lo:101: 00010000:00010000:3.0:1787579912.710004:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787579912.710015:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fae4150fe00/0xc86deac2083375ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc86deac2083375e3 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579912.710035:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fae4150fe00/0xc86deac2083375ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc86deac2083375e3 expref: 13 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579912.710044:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fae4150fe00/0xc86deac2083375ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac2083375e3 expref: 13 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579912.710052:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae4150fe00, rc 0) 00000100:00100000:3.0:1787579912.710092:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5ba0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+13:7636:x1874413262749824:12345-0@lo:101: Request processed in 100us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579912.710099:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787579912.710169:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae74638380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:7636:1874413262749824:0@lo:101: 00010000:00010000:2.0:1787579912.710180:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff8fae41661200/0xc86deac2083375e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac2083375ea expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579912.710187:0:7636:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff8fae41661200/0xc86deac2083375e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc86deac2083375ea expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579912.710261:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae74638380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:7636:1874413262749952:0@lo:501: 00000100:00100000:2.0:1787579912.710287:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579912.710622:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae5dd21cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787579912.710887:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262749952 00000100:00100000:1.0:1787579912.710892:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262749952 00000100:00100000:1.0:1787579912.710922:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787579912.710929:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5ba08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+13:7636:x1874413262749952:12345-0@lo:501: 00000100:00100000:1.0:1787579912.711276:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5ba08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+13:7636:x1874413262749952:12345-0@lo:501: Request processed in 347us (987us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579912.711283:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787579912.712152:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae74638380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:7636:1874413262749952:0@lo:501: 00000100:00100000:2.0:1787579912.712288:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae74638380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:7636:1874413262750080:0@lo:503: 00000100:00100000:1.0:1787579912.712461:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262749696 00000100:00100000:1.0:1787579912.712467:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262749696 00000100:00100000:1.0:1787579912.712525:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787579912.712535:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7f5b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+13:3317:x1874413262749696:12345-0@lo:103: 00010000:00010000:1.0:1787579912.712547:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787579912.712566:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fae50feb200/0xc86deac2083375dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc86deac2083375d5 expref: 13 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579912.712583:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787579912.712738:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579912.712766:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae5dd21cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787579912.712830:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262750080 00000100:00100000:3.0:1787579912.712834:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262750080 00000100:00100000:3.0:1787579912.712870:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787579912.712877:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5ba08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+13:7636:x1874413262750080:12345-0@lo:503: 00000100:00100000:3.0:1787579912.713068:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5ba08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+13:7636:x1874413262750080:12345-0@lo:503: Request processed in 191us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579912.713076:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787579912.713169:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae74638380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:7636:1874413262750080:0@lo:503: 00000040:00080000:2.0:1787579912.713644:0:7636:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787579912.713716:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae74638380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:7636:1874413262750208:0@lo:502: 00000100:00100000:2.0:1787579912.713756:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579912.713781:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae5dd21cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787579912.713852:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262750208 00000100:00100000:3.0:1787579912.713857:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262750208 00000100:00100000:3.0:1787579912.713925:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787579912.713933:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5ba09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+13:7636:x1874413262750208:12345-0@lo:502: 00000100:00100000:3.0:1787579912.714083:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5ba09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+13:7636:x1874413262750208:12345-0@lo:502: Request processed in 151us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579912.714090:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787579912.714167:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae74638380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:7636:1874413262750208:0@lo:502: 00000040:00080000:2.0:1787579912.714593:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1787579912.714653:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1787579912.714691:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1787579912.714740:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1787579912.714779:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1787579912.714815:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1787579912.714843:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae74638380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:7636:1874413262750336:0@lo:502: 00000100:00100000:2.0:1787579912.714887:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579912.714921:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae5dd21cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787579912.714942:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262750336 00000100:00100000:2.0:1787579912.714948:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262750336 00000100:00100000:2.0:1787579912.714977:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787579912.714984:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5ba08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+13:7636:x1874413262750336:12345-0@lo:502: 00000100:00100000:2.0:1787579912.715134:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5ba08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+13:7636:x1874413262750336:12345-0@lo:502: Request processed in 149us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579912.715141:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787579912.715189:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae74638380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:7636:1874413262750336:0@lo:502: 00000040:00080000:2.0:1787579912.715486:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1787579912.715498:0:7636:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000100:00100000:1.0:1787579912.717435:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7f5b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+12:3317:x1874413262749696:12345-0@lo:103: Request processed in 4892us (7604us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579912.717452:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000020:01000000:2.0:1787579912.717794:0:7644:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787579912.717804:0:7644:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1787579912.717812:0:7644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787579912.717814:0:7644:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1787579912.717821:0:7644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787579912.717857:0:7644:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8fae7e9d8000) 00000020:00000080:2.0:1787579912.717883:0:7644:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:2.0:1787579912.717890:0:7644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787579912.717966:0:7644:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8fae77937800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1787579912.717976:0:7644:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787579912.717983:0:7644:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc86deac2083375f8 00010000:00010000:3.0:1787579912.723695:0:7644:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:3.0:1787579912.724039:0:7644:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:2.0:1787579912.731407:0:7644:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1787579912.731722:0:7644:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00000100:00100000:0.0:1787579912.732449:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae48c90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3317:1874413262749696:0@lo:103: 00080000:10000000:2.0:1787579912.756856:0:7644:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1787579912.764550:0:7644:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1787579912.768436:0:7644:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1787579912.768450:0:7644:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787579912.768457:0:7644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787579912.768459:0:7644:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1787579912.768463:0:7644:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787579912.768466:0:7644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787579912.768468:0:7644:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787579912.768471:0:7644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787579912.768473:0:7644:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787579912.768541:0:7644:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787579912.768545:0:7644:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787579912.768546:0:7644:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787579912.768549:0:7644:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1787579912.773781:0:7636:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1787579912.773833:0:7636:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1787579912.773862:0:7636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae41661200/0xc86deac2083375e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac2083375ea expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579912.773875:0:7636:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff8fae41661200/0xc86deac2083375e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac2083375ea expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787579912.773908:0:7636:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8fae77937800 from 1 10000000:01000000:1.0:1787579912.773912:0:7636:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787579912.773970:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae4ca58600/0xc86deac2083375ff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579912.773979:0:7636:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff8fae4ca58600/0xc86deac2083375ff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579912.774001:0:7636:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff8fae4ca58600/0xc86deac2083375ff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579912.774026:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae48c91180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:7636:1874413262750464:0@lo:101: 00000100:00100000:1.0:1787579912.774100:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579912.774158:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae52111b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787579912.774489:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262750464 00000100:00100000:0.0:1787579912.774498:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262750464 00000100:00100000:0.0:1787579912.774547:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787579912.774556:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5ba0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+12:7636:x1874413262750464:12345-0@lo:101: 00010000:00010000:0.0:1787579912.774570:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787579912.774583:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fae50fea000/0xc86deac208337606 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc86deac2083375ff expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579912.774610:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fae50fea000/0xc86deac208337606 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc86deac2083375ff expref: 13 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579912.774642:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fae50fea000/0xc86deac208337606 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac2083375ff expref: 13 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579912.774653:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae50fea000, rc 0) 00000100:00100000:0.0:1787579912.774709:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5ba0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+13:7636:x1874413262750464:12345-0@lo:101: Request processed in 154us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579912.774716:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787579912.774843:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae48c91180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:7636:1874413262750464:0@lo:101: 00010000:00010000:2.0:1787579912.774859:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff8fae4ca58600/0xc86deac2083375ff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208337606 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579912.774869:0:7636:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff8fae4ca58600/0xc86deac2083375ff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc86deac208337606 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579912.775011:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae74638380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:7636:1874413262750592:0@lo:501: 00000100:00100000:2.0:1787579912.775042:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579912.775074:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae5dd21300 going to sleep for 11 seconds 00000100:00100000:1.0:1787579912.775203:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262750592 00000100:00100000:1.0:1787579912.775216:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262750592 00000100:00100000:1.0:1787579912.775253:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787579912.775261:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5ba09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+13:7636:x1874413262750592:12345-0@lo:501: 00000100:00100000:1.0:1787579912.775561:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5ba09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+13:7636:x1874413262750592:12345-0@lo:501: Request processed in 299us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579912.775568:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787579912.775829:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae74638380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:7636:1874413262750592:0@lo:501: 00000100:00100000:2.0:1787579912.775863:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae74638380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:7636:1874413262750720:0@lo:503: 00000100:00100000:2.0:1787579912.775914:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579912.775935:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae5dd21300 going to sleep for 11 seconds 00000100:00100000:0.0:1787579912.776017:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262750720 00000100:00100000:0.0:1787579912.776022:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262750720 00000100:00100000:0.0:1787579912.776055:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787579912.776063:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5ba08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+13:7636:x1874413262750720:12345-0@lo:503: 00000100:00100000:0.0:1787579912.776746:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5ba08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+13:7636:x1874413262750720:12345-0@lo:503: Request processed in 681us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579912.776754:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787579912.781545:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae74638380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:7636:1874413262750720:0@lo:503: 00000040:00080000:2.0:1787579912.782367:0:7636:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787579912.782498:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae74638380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:7636:1874413262750848:0@lo:502: 00000100:00100000:2.0:1787579912.782576:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579912.782622:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae5dd21300 going to sleep for 11 seconds 00000100:00100000:3.0:1787579912.784985:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262750848 00000100:00100000:3.0:1787579912.785012:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262750848 00000100:00100000:3.0:1787579912.785080:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787579912.785090:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5ba0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+13:7636:x1874413262750848:12345-0@lo:502: 00000100:00100000:3.0:1787579912.785479:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5ba0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+13:7636:x1874413262750848:12345-0@lo:502: Request processed in 390us (2902us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579912.785488:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787579912.791776:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae74638380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:7636:1874413262750848:0@lo:502: 00000040:00080000:0.0:1787579912.792206:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1787579912.792279:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1787579912.792681:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7f5bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:7636:1874413262750976:0@lo:502: 00000100:00100000:0.0:1787579912.792756:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579912.792796:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae6d204a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787579912.794079:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262750976 00000100:00100000:2.0:1787579912.794092:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262750976 00000100:00100000:2.0:1787579912.794156:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787579912.794167:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5ba0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+13:7636:x1874413262750976:12345-0@lo:502: 00000100:00100000:2.0:1787579912.794478:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5ba0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+13:7636:x1874413262750976:12345-0@lo:502: Request processed in 312us (1721us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579912.794486:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787579912.794505:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7f5bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:7636:1874413262750976:0@lo:502: 00000040:00080000:3.0:1787579912.794651:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1787579912.794667:0:7636:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1787579912.795341:0:7648:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787579912.795352:0:7648:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787579912.795355:0:7648:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787579912.795363:0:7648:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8fae77937800 00000020:00000080:3.0:1787579912.795366:0:7648:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787579912.795435:0:7648:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787579912.795440:0:7648:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787579912.795442:0:7648:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1787579912.795445:0:7648:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1787579912.795719:0:7636:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1787579912.795744:0:7636:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787579912.795758:0:7636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae4ca58600/0xc86deac2083375ff lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208337606 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579912.795770:0:7636:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff8fae4ca58600/0xc86deac2083375ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208337606 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787579912.795827:0:7636:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787579912.795830:0:7636:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8fae77937800 10000000:01000000:0.0:1787579912.795833:0:7636:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8fae77937800 10000000:01000000:0.0:1787579912.795837:0:7636:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787579912.795842:0:7636:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8fae77937800 from 1 10000000:01000000:0.0:1787579912.795857:0:7636:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787579912.795892:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae50feb400/0xc86deac20833760d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579912.795900:0:7636:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff8fae50feb400/0xc86deac20833760d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579912.795912:0:7636:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff8fae50feb400/0xc86deac20833760d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579912.795933:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7f5b8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:7636:1874413262751104:0@lo:101: 00000100:00100000:0.0:1787579912.796005:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579912.796049:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae6d2049c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787579912.796493:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262751104 00000100:00100000:3.0:1787579912.796501:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262751104 00000100:00100000:3.0:1787579912.796566:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787579912.796576:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5ba0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+13:7636:x1874413262751104:12345-0@lo:101: 00010000:00010000:3.0:1787579912.796588:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787579912.796601:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fae4150ee00/0xc86deac208337614 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc86deac20833760d expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579912.796625:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fae4150ee00/0xc86deac208337614 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc86deac20833760d expref: 14 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579912.796651:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fae4150ee00/0xc86deac208337614 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac20833760d expref: 14 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579912.796662:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae4150ee00, rc 0) 00000100:00100000:3.0:1787579912.796705:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5ba0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+14:7636:x1874413262751104:12345-0@lo:101: Request processed in 130us (699us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579912.796711:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787579912.797168:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7f5b8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:7636:1874413262751104:0@lo:101: 00010000:00010000:0.0:1787579912.797189:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff8fae50feb400/0xc86deac20833760d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208337614 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579912.797198:0:7636:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff8fae50feb400/0xc86deac20833760d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc86deac208337614 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579912.797321:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7f5b8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:7636:1874413262751232:0@lo:501: 00000100:00100000:0.0:1787579912.797356:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579912.797427:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae6d2049c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787579912.797650:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262751232 00000100:00100000:2.0:1787579912.797657:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262751232 00000100:00100000:2.0:1787579912.797698:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787579912.797707:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+14:7636:x1874413262751232:12345-0@lo:501: 00000100:00100000:2.0:1787579912.798059:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+14:7636:x1874413262751232:12345-0@lo:501: Request processed in 352us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579912.798067:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787579912.798361:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7f5b8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:7636:1874413262751232:0@lo:501: 00000100:00100000:0.0:1787579912.798441:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7f5b8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:7636:1874413262751360:0@lo:503: 00000100:00100000:0.0:1787579912.798482:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579912.798504:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae6d2049c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787579912.798612:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262751360 00000100:00100000:2.0:1787579912.798617:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262751360 00000100:00100000:2.0:1787579912.798652:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787579912.798659:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+14:7636:x1874413262751360:12345-0@lo:503: 00000100:00100000:2.0:1787579912.798866:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+14:7636:x1874413262751360:12345-0@lo:503: Request processed in 206us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579912.798872:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787579912.809075:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7f5b8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:7636:1874413262751360:0@lo:503: 00000040:00080000:3.0:1787579912.809710:0:7636:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787579912.809804:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5f4aea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:7636:1874413262751488:0@lo:502: 00000100:00100000:3.0:1787579912.809901:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579912.809949:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae48730000 going to sleep for 11 seconds 00000100:00100000:2.0:1787579912.810037:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262751488 00000100:00100000:2.0:1787579912.810046:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262751488 00000100:00100000:2.0:1787579912.810109:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787579912.810119:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+14:7636:x1874413262751488:12345-0@lo:502: 00000100:00100000:2.0:1787579912.810409:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+14:7636:x1874413262751488:12345-0@lo:502: Request processed in 256us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579912.810417:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787579912.810916:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5f4aea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:7636:1874413262751488:0@lo:502: 00000040:00080000:3.0:1787579912.811225:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1787579912.811285:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1787579912.811348:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1787579912.811443:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1787579912.811483:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1787579912.811720:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1787579912.811760:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1787579912.811795:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1787579912.811862:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1787579912.811900:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1787579912.811932:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1787579912.811976:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1787579912.812011:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1787579912.812043:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1787579912.812089:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1787579912.812138:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1787579912.812170:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1787579912.812233:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1787579912.812283:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1787579912.814896:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1787579912.814978:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1787579912.815006:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1787579912.815034:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1787579912.815080:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1787579912.815115:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1787579912.815146:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1787579912.815192:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1787579912.815230:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:3.0:1787579912.815259:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1787579912.816327:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:0.0:1787579912.816454:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:0.0:1787579912.816488:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:0.0:1787579912.816715:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:0.0:1787579912.816779:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:0.0:1787579912.816818:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:0.0:1787579912.816866:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:0.0:1787579912.816901:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:0.0:1787579912.816951:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7f5b8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:7636:1874413262751616:0@lo:502: 00000100:00100000:0.0:1787579912.817049:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579912.817166:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae6d204840 going to sleep for 11 seconds 00000100:00100000:2.0:1787579912.817898:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262751616 00000100:00100000:2.0:1787579912.817908:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262751616 00000100:00100000:2.0:1787579912.817966:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787579912.817977:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+14:7636:x1874413262751616:12345-0@lo:502: 00000100:00100000:2.0:1787579912.818261:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+14:7636:x1874413262751616:12345-0@lo:502: Request processed in 285us (1211us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579912.818269:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787579912.818497:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7f5b8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:7636:1874413262751616:0@lo:502: 00000040:00080000:1.0:1787579912.818621:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:1.0:1787579912.818637:0:7636:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:0.0:1787579912.821672:0:7649:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1787579912.821691:0:7649:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8fae74de8000) 00000020:00000080:0.0:1787579912.821713:0:7649:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:0.0:1787579912.821793:0:7649:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8fae77937800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787579912.821797:0:7649:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8fae77937800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787579912.821799:0:7649:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8fae77937800 3 00010000:00080000:0.0:1787579912.821830:0:7649:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8fae6d1e4000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.136@tcp at head 00010000:00010000:0.0:1787579912.827864:0:7649:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:0.0:1787579912.828056:0:7649:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1787579912.828097:0:7649:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787579912.828110:0:7649:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xc86deac208337622 00000100:00080000:0.0:1787579912.828121:0:7649:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787579912.828129:0:7649:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8fae6d1e4000 using connection 192.168.202.136@tcp/0@lo 00000100:00100000:0.0:1787579912.828171:0:7649:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fae7f5baa00 x1874413262751744/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787579912.828192:0:7649:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787579912.828282:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7f5b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874413262751872:0@lo:400: 00000100:00100000:0.0:1787579912.828356:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579912.828527:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7f5baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3313:1874413262751744:0@lo:38: 00000100:00100000:3.0:1787579912.828560:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579912.830686:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262751872 00000100:00100000:2.0:1787579912.830698:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262751872 00000100:00100000:2.0:1787579912.830756:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262751744 00000100:00100000:2.0:1787579912.830760:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262751744 00000100:00100000:2.0:1787579912.830777:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787579912.830786:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7f5bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874413262751872:12345-0@lo:400: 00000100:00100000:2.0:1787579912.830871:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7f5bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874413262751872:12345-0@lo:400: Request processed in 86us (2513us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579912.830878:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787579912.830895:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787579912.830907:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5f4aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3313:x1874413262751744:12345-0@lo:38: 00010000:00080000:2.0:1787579912.830929:0:5854:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 260 last 0 00000020:00000080:2.0:1787579912.830979:0:5854:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xc86deac208337629 00000004:00100000:2.0:1787579912.830995:0:5854:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787579912.831028:0:5854:0:(import.c:65:import_set_state_nolock()) ffff8fae5068a800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787579912.831073:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5f4aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874413262751744:12345-0@lo:38: Request processed in 166us (2511us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579912.831080:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787579912.831130:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fae7f5baa00 x1874413262751744/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787579922 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787579912.831157:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787579912.831166:0:3313:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1787579912.831174:0:3313:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787579912.831180:0:3313:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787579912.831182:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8fae6d1e4000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787579912.831189:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7f5baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3313:1874413262751744:0@lo:38: 00010000:00080000:0.0:1787579912.833485:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fae7f5b9f80 x1874413262751872/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787579928 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787579912.833504:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7f5b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874413262751872:0@lo:400: 00000100:00100000:3.0:1787579912.833675:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787579912.833697:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7f5ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874413262752128:0@lo:400: 00000100:00100000:3.0:1787579912.833760:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579912.833801:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262752128 00000100:00100000:3.0:1787579912.833808:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262752128 00000100:00100000:3.0:1787579912.833876:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787579912.833886:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5f4adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1874413262752128:12345-0@lo:400: 00000100:00100000:3.0:1787579912.833940:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5f4adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1874413262752128:12345-0@lo:400: Request processed in 56us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579912.833948:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1787579912.833979:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fae7f5ba680 x1874413262752128/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787579928 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787579912.833988:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7f5ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874413262752128:0@lo:400: 00000100:00100000:0.0:1787579912.834059:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787579912.834067:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7f5b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874413262752000:0@lo:400: 00000100:00100000:0.0:1787579912.834099:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787579912.834672:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787579912.841858:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262752000 00000100:00100000:3.0:1787579912.841876:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262752000 00000100:00100000:3.0:1787579912.841969:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787579912.841981:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7f5b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874413262752000:12345-0@lo:400: 00000100:00100000:3.0:1787579912.842087:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7f5b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874413262752000:12345-0@lo:400: Request processed in 108us (7984us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579912.842095:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1787579912.842681:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fae7f5b9180 x1874413262752000/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787579928 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787579912.842697:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7f5b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874413262752000:0@lo:400: 00000100:00080000:2.0:1787579912.843094:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787579912.843341:0:7651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5f4aca80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7651:1874413262752256:0@lo:901: 00000100:00100000:3.0:1787579912.843460:0:7651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579912.843486:0:7651:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae48730240 going to sleep for 11 seconds 00000100:00100000:1.0:1787579912.843652:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262752256 00000100:00100000:1.0:1787579912.843659:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262752256 00000100:00100000:1.0:1787579912.843715:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787579912.843735:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5f4ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7651:x1874413262752256:12345-0@lo:901: 00000100:00100000:1.0:1787579912.844190:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5f4ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7651:x1874413262752256:12345-0@lo:901: Request processed in 456us (728us total) trans 0 rc 0/0 00000100:00080000:2.0:1787579912.844285:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787579912.844408:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787579912.844449:0:7651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fae5f4aca80 x1874413262752256/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1787579928 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787579912.844461:0:7651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5f4aca80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7651:1874413262752256:0@lo:901: 00000040:00080000:0.0:1787579912.844769:0:7649:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:1.0:1787579912.844910:0:7636:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1787579912.844937:0:7636:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787579912.844960:0:7636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae50feb400/0xc86deac20833760d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208337614 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579912.844970:0:7636:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff8fae50feb400/0xc86deac20833760d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208337614 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787579912.845021:0:7636:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787579912.845023:0:7636:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787579912.845025:0:7636:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787579912.845026:0:7636:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787579912.845027:0:7636:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787579912.845029:0:7636:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787579912.845030:0:7636:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787579912.845032:0:7636:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787579912.845033:0:7636:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787579912.845035:0:7636:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787579912.845036:0:7636:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787579912.845039:0:7636:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:1.0:1787579912.845042:0:7636:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787579912.845043:0:7636:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787579912.845044:0:7636:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787579912.845045:0:7636:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787579912.845046:0:7636:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787579912.845052:0:7636:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787579912.845053:0:7636:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787579912.845054:0:7636:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787579912.845055:0:7636:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787579912.845056:0:7636:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787579912.845057:0:7636:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787579912.845077:0:7636:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1787579912.845089:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae48c91180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:7636:1874413262752384:0@lo:253: 00000100:00100000:1.0:1787579912.845133:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579912.845171:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae52111cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787579912.845319:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262752384 00000100:00100000:0.0:1787579912.845325:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262752384 00000100:00100000:0.0:1787579912.845369:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787579912.845424:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+14:7636:x1874413262752384:12345-0@lo:253: 20000000:01000000:0.0:1787579912.845449:0:5847:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1787579912.845462:0:5847:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787579912.883505:0:5847:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787579912.883533:0:5847:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1787579912.883636:0:5868:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787579912.883643:0:5868:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787579912.883668:0:5868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8fae50fea200/0xc86deac208337630 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579912.883688:0:5868:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fae41661a00/0xc86deac208337581 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac20833757a expref: 14 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579912.883709:0:5868:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8fae50fea200/0xc86deac208337630 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579912.883752:0:5868:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fae41661a00/0xc86deac208337581 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc86deac20833757a expref: 14 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579912.883766:0:5868:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fae41661a00/0xc86deac208337581 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc86deac20833757a expref: 14 pid: 5848 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579912.883782:0:5868:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7f5b9180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5868:1874413262752512:0@lo:104: 00000100:00100000:0.0:1787579912.883848:0:5868:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579912.883896:0:5868:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae6d204840 going to sleep for 11 seconds 00000100:00100000:3.0:1787579912.883951:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262752512 00000100:00100000:3.0:1787579912.883958:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262752512 00000100:00100000:3.0:1787579912.884010:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787579912.884019:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7f5bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+3:5868:x1874413262752512:12345-0@lo:104: 00010000:00010000:3.0:1787579912.884031:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.136@tcp lock: ffff8fae4ca59800/0xc86deac20833757a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc86deac208337581 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579912.884086:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787579912.884093:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7f5bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+3:5868:x1874413262752512:12345-0@lo:104: Request processed in 75us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579912.884099:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1787579912.884123:0:7643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787579912.884129:0:7643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.136@tcp lock: ffff8fae4ca59800/0xc86deac20833757a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc86deac208337581 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579912.884136:0:7643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae4ca59800 already unused, calling callback (ffffffffc1b77c20) 10000000:00010000:3.0:1787579912.884148:0:7643:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.136@tcp lock: ffff8fae4ca59800/0xc86deac20833757a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc86deac208337581 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579912.884158:0:7643:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: ffff8fae4ca59800/0xc86deac20833757a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc86deac208337581 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787579912.884165:0:7643:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: ffff8fae4ca59800/0xc86deac20833757a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc86deac208337581 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787579912.884172:0:7643:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:0.0:1787579912.884317:0:5868:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7f5b9180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5868:1874413262752512:0@lo:104: 00010000:00010000:0.0:1787579912.884336:0:5868:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8fae50fea200/0xc86deac208337630 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579912.884502:0:7643:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.136@tcp lock: ffff8fae4ca59800/0xc86deac20833757a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac208337581 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579912.884509:0:7643:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787579912.884615:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5f4af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3317:1874413262752640:0@lo:103: 00000100:00100000:0.0:1787579912.884649:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787579912.884702:0:7643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.136@tcp lock: ffff8fae4ca59800/0xc86deac20833757a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac208337581 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579912.884709:0:7643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: ffff8fae4ca59800/0xc86deac20833757a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac208337581 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579912.884725:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579912.884727:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579912.884729:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787579912.886910:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262752640 00000100:00100000:2.0:1787579912.886925:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262752640 00010000:00010000:2.0:1787579912.886966:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fae41661a00/0xc86deac208337581 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc86deac20833757a expref: 15 pid: 5848 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579912.887006:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787579912.887015:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae52137c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+15:3317:x1874413262752640:12345-0@lo:103: 00010000:00010000:2.0:1787579912.887030:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787579912.887046:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fae41661a00/0xc86deac208337581 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc86deac20833757a expref: 15 pid: 5848 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579912.887059:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fae41661a00/0xc86deac208337581 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc86deac20833757a expref: 15 pid: 5848 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579912.887077:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fae41661a00/0xc86deac208337581 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc86deac20833757a expref: 15 pid: 5848 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579912.887092:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8fae50fea200/0xc86deac208337630 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579912.887101:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fae50fea200/0xc86deac208337630 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787579912.887119:0:5840:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003477661s 00010000:00010000:2.0:1787579912.887124:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fae50fea200/0xc86deac208337630 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579912.887132:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fae50fea200/0xc86deac208337630 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579912.887139:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8fae50fea200/0xc86deac208337630 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579912.887146:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8fae50fea200/0xc86deac208337630 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579912.887152:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae50fea200 already unused, calling callback (ffffffffc155a230) 00010000:00010000:2.0:1787579912.887157:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8fae50fea200/0xc86deac208337630 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579912.887165:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8fae50fea200/0xc86deac208337630 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579912.887191:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8fae50fea200/0xc86deac208337630 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579912.887213:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787579912.890464:0:5868:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8fae50fea200/0xc86deac208337630 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579912.890485:0:5868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8fae50fea200/0xc86deac208337630 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579912.890493:0:5868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fae50fea200/0xc86deac208337630 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579912.891191:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae52137c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+14:3317:x1874413262752640:12345-0@lo:103: Request processed in 4169us (6531us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579912.891215:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787579912.896363:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5f4af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3317:1874413262752640:0@lo:103: 00000100:00100000:3.0:1787579912.899139:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+13:7636:x1874413262752384:12345-0@lo:253: Request processed in 53710us (53996us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579912.899153:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787579912.899441:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae48c91180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:7636:1874413262752384:0@lo:253: 10000000:01000000:1.0:1787579912.899457:0:7636:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1787579912.899461:0:7636:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787579912.899463:0:7636:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787579912.899464:0:7636:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787579912.899465:0:7636:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787579912.899466:0:7636:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787579912.899467:0:7636:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787579912.899469:0:7636:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787579912.899470:0:7636:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787579912.899472:0:7636:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787579912.899473:0:7636:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787579912.899475:0:7636:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787579912.899497:0:7636:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787579912.910213:0:7636:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1787579912.910469:0:7636:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787579912.910672:0:7636:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1787579912.910849:0:7636:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787579912.911101:0:7636:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1787579912.911330:0:7636:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1787579912.914024:0:7636:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1787579913.268572:0:7636:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1787579913.268580:0:7636:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1787579913.268617:0:7636:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787579913.268684:0:7636:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.136@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787579913.268699:0:7636:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1787579913.268727:0:7636:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1787579913.715604:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579914.741680:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787579915.383535:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787579915.383560:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae74639c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874413262752768:0@lo:13: 00000100:00100000:2.0:1787579915.383649:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579915.385496:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262752768 00000100:00100000:2.0:1787579915.385509:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262752768 00000100:00100000:2.0:1787579915.385587:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787579915.385611:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7463bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874413262752768:12345-0@lo:13: 00002000:00000024:2.0:1787579915.385651:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787579915.385723:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7463bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874413262752768:12345-0@lo:13: Request processed in 127us (2074us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579915.385730:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1787579915.385775:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae74639c00 x1874413262752768/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787579931 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787579915.385808:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae74639c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874413262752768:0@lo:13: 00000100:00080000:0.0:1787579915.386736:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787579915.766476:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579916.787753:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579917.811744:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787579917.939612:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7f5bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1874413262753152:0@lo:400: 00000100:00100000:0.0:1787579917.939687:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579917.939749:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787579917.939756:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7f5bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874413262753024:0@lo:400: 00000100:00100000:0.0:1787579917.939779:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579917.940130:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7f5b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874413262753280:0@lo:400: 00000100:00100000:3.0:1787579917.940164:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579917.940194:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787579917.940200:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7f5b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3314:1874413262752896:0@lo:400: 00000100:00100000:3.0:1787579917.940228:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579917.940248:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7f5b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874413262753408:0@lo:400: 00000100:00100000:3.0:1787579917.940269:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579917.940300:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262753152 00000100:00100000:3.0:1787579917.940307:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262753152 00000100:00100000:3.0:1787579917.940365:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262753024 00000100:00100000:3.0:1787579917.940369:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262753024 00000100:00100000:3.0:1787579917.940736:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262753408 00000100:00100000:3.0:1787579917.940740:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262753408 00000100:00100000:3.0:1787579917.940764:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787579917.940774:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7f5b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874413262753152:12345-0@lo:400: 00000100:00100000:3.0:1787579917.940845:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7f5b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874413262753152:12345-0@lo:400: Request processed in 71us (1156us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579917.940852:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787579917.940871:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787579917.940877:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7f5ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874413262753024:12345-0@lo:400: 00000100:00100000:3.0:1787579917.940905:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7f5ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874413262753024:12345-0@lo:400: Request processed in 29us (1126us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579917.940910:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787579917.940921:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787579917.940926:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5f4af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874413262753408:12345-0@lo:400: 00000100:00100000:3.0:1787579917.940969:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5f4af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874413262753408:12345-0@lo:400: Request processed in 43us (699us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579917.940976:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787579917.941065:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262753280 00000100:00100000:3.0:1787579917.941069:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262753280 00000100:00100000:3.0:1787579917.941099:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787579917.941106:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5f4ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874413262753280:12345-0@lo:400: 00000100:00100000:3.0:1787579917.941136:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5f4ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874413262753280:12345-0@lo:400: Request processed in 31us (972us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579917.941142:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787579917.941163:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262752896 00000100:00100000:3.0:1787579917.941167:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262752896 00000100:00080000:1.0:1787579917.941433:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787579917.941439:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787579917.941485:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae7f5b9880 x1874413262753408/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787579933 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787579917.941500:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7f5b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874413262753408:0@lo:400: 00010000:00080000:1.0:1787579917.941514:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae7f5b9500 x1874413262753280/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787579933 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787579917.941522:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7f5b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874413262753280:0@lo:400: 00010000:00080000:1.0:1787579917.941567:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae7f5bb800 x1874413262753024/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787579933 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787579917.941577:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7f5bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874413262753024:0@lo:400: 00010000:00080000:1.0:1787579917.941592:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae7f5bbb80 x1874413262753152/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787579933 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787579917.941601:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7f5bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1874413262753152:0@lo:400: 00000100:00100000:3.0:1787579917.941860:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787579917.941869:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+13:3314:x1874413262752896:12345-0@lo:400: 00000100:00100000:3.0:1787579917.941917:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+13:3314:x1874413262752896:12345-0@lo:400: Request processed in 50us (1688us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579917.941923:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787579917.943338:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7f5b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3314:1874413262752896:0@lo:400: 00010000:00010000:1.0:1787579918.837112:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787579919.862884:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787579920.502887:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae48c91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262753536:0@lo:13: 00000100:00100000:2.0:1787579920.502968:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579920.503228:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262753536 00000100:00100000:0.0:1787579920.503238:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262753536 00000100:00100000:0.0:1787579920.503318:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787579920.503329:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74639c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262753536:12345-0@lo:13: 00002000:00000024:0.0:1787579920.503365:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787579920.503583:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74639c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262753536:12345-0@lo:13: Request processed in 192us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579920.503593:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1787579920.503881:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae48c91180 x1874413262753536/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787579936 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787579920.503902:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae48c91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262753536:0@lo:13: 00000100:00080000:2.0:1787579920.506897:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787579920.886975:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787579921.007968:0:7992:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg236-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 10000000:01000000:3.0:1787579921.011556:0:5850:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787579921.011564:0:5850:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8fae50613000 from 30 10000000:01000000:3.0:1787579921.011569:0:5850:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787579921.011623:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae4150fc00/0xc86deac208337637 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579921.011635:0:5850:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff8fae4150fc00/0xc86deac208337637 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579921.012190:0:5850:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff8fae4150fc00/0xc86deac208337637 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579921.012236:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5f4ac000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262753664:0@lo:101: 00000100:00100000:3.0:1787579921.012317:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579921.012371:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae455a9300 going to sleep for 11 seconds 00000100:00100000:0.0:1787579921.012581:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262753664 00000100:00100000:0.0:1787579921.012590:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262753664 00000100:00100000:0.0:1787579921.012643:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787579921.013168:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+13:5850:x1874413262753664:12345-0@lo:101: 00010000:00010000:0.0:1787579921.013185:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787579921.013200:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fae50feb200/0xc86deac20833763e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc86deac208337637 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579921.013226:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fae50feb200/0xc86deac20833763e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc86deac208337637 expref: 14 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579921.013250:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fae50feb200/0xc86deac20833763e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac208337637 expref: 14 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579921.013259:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae50feb200, rc 0) 00000100:00100000:0.0:1787579921.013327:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+14:5850:x1874413262753664:12345-0@lo:101: Request processed in 164us (1010us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579921.013334:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787579921.013637:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5f4ac000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262753664:0@lo:101: 00010000:00010000:2.0:1787579921.013763:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff8fae4150fc00/0xc86deac208337637 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac20833763e expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579921.013774:0:5850:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff8fae4150fc00/0xc86deac208337637 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc86deac20833763e expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579921.013840:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae74638700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262753792:0@lo:501: 00000100:00100000:2.0:1787579921.013874:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579921.013950:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae45236000 going to sleep for 11 seconds 00000100:00100000:3.0:1787579921.019112:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262753792 00000100:00100000:3.0:1787579921.019136:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262753792 00000100:00100000:3.0:1787579921.019199:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787579921.019210:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+14:5850:x1874413262753792:12345-0@lo:501: 00000100:00100000:3.0:1787579921.019910:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+14:5850:x1874413262753792:12345-0@lo:501: Request processed in 699us (6033us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579921.019919:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787579921.019986:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae74638700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262753792:0@lo:501: 00000100:00100000:3.0:1787579921.020044:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5f4aca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262753920:0@lo:503: 00000100:00100000:3.0:1787579921.020091:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579921.020232:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262753920 00000100:00100000:0.0:1787579921.020237:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262753920 00000100:00100000:0.0:1787579921.020265:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787579921.020272:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+14:5850:x1874413262753920:12345-0@lo:503: 00000100:00100000:0.0:1787579921.020595:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+14:5850:x1874413262753920:12345-0@lo:503: Request processed in 322us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579921.020603:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787579921.021211:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae455a9600 going to sleep for 11 seconds 00000100:00100000:3.0:1787579921.021229:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5f4aca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262753920:0@lo:503: 00000100:00100000:0.0:1787579921.022894:0:7993:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7f5baa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:7993:1874413262754048:0@lo:502: 00000100:00100000:0.0:1787579921.022973:0:7993:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579921.023007:0:7993:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae77a32c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787579921.023071:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262754048 00000100:00100000:3.0:1787579921.023080:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262754048 00000100:00100000:3.0:1787579921.023215:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787579921.023225:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+14:7993:x1874413262754048:12345-0@lo:502: 00000100:00100000:3.0:1787579921.023906:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+14:7993:x1874413262754048:12345-0@lo:502: Request processed in 680us (929us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579921.023915:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787579921.024804:0:7993:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7f5baa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:7993:1874413262754048:0@lo:502: 00000100:00100000:0.0:1787579921.024876:0:7993:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7f5baa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:7993:1874413262754176:0@lo:502: 00000100:00100000:0.0:1787579921.024931:0:7993:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579921.024963:0:7993:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae77a32c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787579921.025237:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262754176 00000100:00100000:3.0:1787579921.025245:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262754176 00000100:00100000:3.0:1787579921.025308:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787579921.025329:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+14:7993:x1874413262754176:12345-0@lo:502: 00000100:00100000:3.0:1787579921.026887:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+14:7993:x1874413262754176:12345-0@lo:502: Request processed in 1556us (1950us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579921.026900:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787579921.027159:0:7993:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7f5baa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:7993:1874413262754176:0@lo:502: 00000040:00080000:0.0:1787579921.027195:0:7993:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1787579921.028529:0:5850:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1787579921.028558:0:5850:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787579921.028570:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae4150fc00/0xc86deac208337637 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac20833763e expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579921.028582:0:5850:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff8fae4150fc00/0xc86deac208337637 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac20833763e expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787579921.028593:0:5850:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1787579921.028596:0:5850:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:3.0:1787579921.028599:0:5850:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787579921.028637:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae4150f600/0xc86deac208337645 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579921.028656:0:5850:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff8fae4150f600/0xc86deac208337645 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579921.028665:0:5850:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff8fae4150f600/0xc86deac208337645 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579921.028686:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5f4aca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262754304:0@lo:101: 00000100:00100000:3.0:1787579921.028744:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579921.028788:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae455a9d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787579921.028885:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262754304 00000100:00100000:1.0:1787579921.028892:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262754304 00000100:00100000:1.0:1787579921.028940:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787579921.028950:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+14:5850:x1874413262754304:12345-0@lo:101: 00010000:00010000:1.0:1787579921.028962:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787579921.028975:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fae4ca58800/0xc86deac20833764c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc86deac208337645 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579921.028997:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fae4ca58800/0xc86deac20833764c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc86deac208337645 expref: 15 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579921.029006:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fae4ca58800/0xc86deac20833764c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac208337645 expref: 15 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579921.029015:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae4ca58800, rc 0) 00000100:00100000:1.0:1787579921.029057:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+15:5850:x1874413262754304:12345-0@lo:101: Request processed in 109us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579921.029072:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787579921.029115:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5f4aca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262754304:0@lo:101: 00010000:00010000:1.0:1787579921.029140:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff8fae4150f600/0xc86deac208337645 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac20833764c expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579921.029148:0:5850:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff8fae4150f600/0xc86deac208337645 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc86deac20833764c expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579921.029195:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae48c90000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262754432:0@lo:501: 00000100:00100000:1.0:1787579921.029222:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579921.029237:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae48760900 going to sleep for 11 seconds 00000100:00100000:1.0:1787579921.029249:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262754432 00000100:00100000:1.0:1787579921.029253:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262754432 00000100:00100000:1.0:1787579921.029274:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787579921.029280:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+15:5850:x1874413262754432:12345-0@lo:501: 00000100:00100000:1.0:1787579921.029706:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+15:5850:x1874413262754432:12345-0@lo:501: Request processed in 424us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579921.029713:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787579921.029745:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae48c90000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262754432:0@lo:501: 00000100:00100000:1.0:1787579921.029771:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae48c90000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262754560:0@lo:503: 00000100:00100000:1.0:1787579921.029805:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579921.029819:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae48760900 going to sleep for 11 seconds 00000100:00100000:1.0:1787579921.029829:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262754560 00000100:00100000:1.0:1787579921.029833:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262754560 00000100:00100000:1.0:1787579921.029853:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787579921.029858:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+15:5850:x1874413262754560:12345-0@lo:503: 00000100:00100000:1.0:1787579921.030947:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+15:5850:x1874413262754560:12345-0@lo:503: Request processed in 1082us (1135us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579921.030958:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787579921.031021:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae48c90000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262754560:0@lo:503: 00000100:00100000:2.0:1787579921.031812:0:7994:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae74638380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:7994:1874413262754688:0@lo:502: 00000100:00100000:2.0:1787579921.031870:0:7994:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579921.031908:0:7994:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae45236000 going to sleep for 11 seconds 00000100:00100000:1.0:1787579921.031949:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262754688 00000100:00100000:1.0:1787579921.031955:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262754688 00000100:00100000:1.0:1787579921.031995:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787579921.032005:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+15:7994:x1874413262754688:12345-0@lo:502: 00000100:00100000:1.0:1787579921.032532:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+15:7994:x1874413262754688:12345-0@lo:502: Request processed in 528us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579921.032541:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787579921.035147:0:7994:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae74638380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:7994:1874413262754688:0@lo:502: 00000020:01000000:2.0:1787579921.035196:0:7994:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787579921.035206:0:7994:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787579921.035209:0:7994:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787579921.035213:0:7994:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787579921.035215:0:7994:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787579921.035249:0:7994:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae74638380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:7994:1874413262754816:0@lo:502: 00000100:00100000:2.0:1787579921.035330:0:7994:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579921.035404:0:7994:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae45236000 going to sleep for 11 seconds 00000100:00100000:3.0:1787579921.035573:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262754816 00000100:00100000:3.0:1787579921.035581:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262754816 00000100:00100000:3.0:1787579921.035640:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787579921.035658:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+15:7994:x1874413262754816:12345-0@lo:502: 00000100:00100000:3.0:1787579921.035870:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+15:7994:x1874413262754816:12345-0@lo:502: Request processed in 221us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579921.035878:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787579921.036004:0:7994:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae74638380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:7994:1874413262754816:0@lo:502: 00000020:01000000:2.0:1787579921.036025:0:7994:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787579921.036030:0:7994:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787579921.036032:0:7994:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787579921.036035:0:7994:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:3.0:1787579921.036312:0:5850:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:3.0:1787579921.036332:0:5850:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1787579921.036342:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae4150f600/0xc86deac208337645 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac20833764c expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579921.036353:0:5850:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff8fae4150f600/0xc86deac208337645 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac20833764c expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787579921.036365:0:5850:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787579921.036368:0:5850:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8fae6a238800 from 30 10000000:01000000:3.0:1787579921.036372:0:5850:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787579921.036508:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae4150fa00/0xc86deac208337653 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579921.036518:0:5850:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff8fae4150fa00/0xc86deac208337653 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579921.036529:0:5850:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff8fae4150fa00/0xc86deac208337653 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579921.036544:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5f4ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262754944:0@lo:101: 00000100:00100000:3.0:1787579921.036580:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579921.036608:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae455a9480 going to sleep for 11 seconds 00000100:00100000:0.0:1787579921.036845:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262754944 00000100:00100000:0.0:1787579921.036851:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262754944 00000100:00100000:0.0:1787579921.036906:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787579921.036915:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+15:5850:x1874413262754944:12345-0@lo:101: 00010000:00010000:0.0:1787579921.036925:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787579921.036937:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fae50feaa00/0xc86deac20833765a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc86deac208337653 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579921.036958:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fae50feaa00/0xc86deac20833765a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc86deac208337653 expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579921.036969:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fae50feaa00/0xc86deac20833765a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac208337653 expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579921.036978:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae50feaa00, rc 0) 00000100:00100000:0.0:1787579921.037018:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+16:5850:x1874413262754944:12345-0@lo:101: Request processed in 105us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579921.037025:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787579921.037110:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5f4ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262754944:0@lo:101: 00010000:00010000:2.0:1787579921.037133:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff8fae4150fa00/0xc86deac208337653 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac20833765a expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579921.037143:0:5850:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff8fae4150fa00/0xc86deac208337653 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc86deac20833765a expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579921.037187:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae74638380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262755072:0@lo:501: 00000100:00100000:2.0:1787579921.037215:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579921.037243:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae45236000 going to sleep for 11 seconds 00000100:00100000:0.0:1787579921.037350:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262755072 00000100:00100000:0.0:1787579921.037355:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262755072 00000100:00100000:0.0:1787579921.037409:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787579921.037417:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+16:5850:x1874413262755072:12345-0@lo:501: 00000100:00100000:0.0:1787579921.037815:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+16:5850:x1874413262755072:12345-0@lo:501: Request processed in 397us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579921.037823:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787579921.037951:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae74638380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262755072:0@lo:501: 00000100:00100000:2.0:1787579921.037978:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae74638380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262755200:0@lo:503: 00000100:00100000:2.0:1787579921.038014:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579921.038042:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae45236000 going to sleep for 11 seconds 00000100:00100000:2.0:1787579921.038055:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262755200 00000100:00100000:2.0:1787579921.038058:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262755200 00000100:00100000:2.0:1787579921.038087:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787579921.038094:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+16:5850:x1874413262755200:12345-0@lo:503: 00000100:00100000:2.0:1787579921.038375:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+16:5850:x1874413262755200:12345-0@lo:503: Request processed in 281us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579921.038400:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787579921.042785:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae74638380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262755200:0@lo:503: 00000100:00100000:2.0:1787579921.047580:0:7996:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae74638380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:7996:1874413262755328:0@lo:502: 00000100:00100000:2.0:1787579921.047682:0:7996:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579921.047733:0:7996:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae452366c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787579921.047921:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262755328 00000100:00100000:3.0:1787579921.047929:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262755328 00000100:00100000:3.0:1787579921.047981:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787579921.047991:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+16:7996:x1874413262755328:12345-0@lo:502: 00000100:00100000:3.0:1787579921.048275:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+16:7996:x1874413262755328:12345-0@lo:502: Request processed in 283us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579921.048284:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787579921.048768:0:7996:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae74638380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:7996:1874413262755328:0@lo:502: 00000100:00100000:2.0:1787579921.048825:0:7996:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae74638380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:7996:1874413262755456:0@lo:502: 00000100:00100000:2.0:1787579921.048864:0:7996:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579921.048896:0:7996:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae452366c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787579921.048940:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262755456 00000100:00100000:3.0:1787579921.048945:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262755456 00000100:00100000:3.0:1787579921.048979:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787579921.048986:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+16:7996:x1874413262755456:12345-0@lo:502: 00000100:00100000:3.0:1787579921.049159:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+16:7996:x1874413262755456:12345-0@lo:502: Request processed in 173us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579921.049167:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787579921.049285:0:7996:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae74638380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:7996:1874413262755456:0@lo:502: 00000040:00080000:2.0:1787579921.049316:0:7996:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1787579921.049571:0:5850:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1787579921.049588:0:5850:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787579921.049598:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae4150fa00/0xc86deac208337653 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac20833765a expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579921.049610:0:5850:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff8fae4150fa00/0xc86deac208337653 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac20833765a expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787579921.049619:0:5850:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787579921.049622:0:5850:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8fae6a238800 from 5 10000000:01000000:3.0:1787579921.049625:0:5850:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787579921.049724:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae4150f200/0xc86deac208337661 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579921.049733:0:5850:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff8fae4150f200/0xc86deac208337661 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579921.049752:0:5850:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff8fae4150f200/0xc86deac208337661 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579921.049766:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5f4ad880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262755584:0@lo:101: 00000100:00100000:3.0:1787579921.049797:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579921.049822:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae455a9000 going to sleep for 11 seconds 00000100:00100000:2.0:1787579921.050211:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262755584 00000100:00100000:2.0:1787579921.050216:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262755584 00000100:00100000:2.0:1787579921.050255:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787579921.050263:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+16:5850:x1874413262755584:12345-0@lo:101: 00010000:00010000:2.0:1787579921.050274:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787579921.050288:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fae41661a00/0xc86deac208337668 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc86deac208337661 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579921.050319:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fae41661a00/0xc86deac208337668 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc86deac208337661 expref: 17 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579921.050329:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fae41661a00/0xc86deac208337668 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac208337661 expref: 17 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579921.050338:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae41661a00, rc 0) 00000100:00100000:2.0:1787579921.050375:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+17:5850:x1874413262755584:12345-0@lo:101: Request processed in 113us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579921.050405:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787579921.050530:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5f4ad880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262755584:0@lo:101: 00010000:00010000:2.0:1787579921.050544:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff8fae4150f200/0xc86deac208337661 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208337668 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579921.050552:0:5850:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff8fae4150f200/0xc86deac208337661 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc86deac208337668 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579921.050604:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae74638380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262755712:0@lo:256: 00000100:00100000:2.0:1787579921.050634:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579921.051110:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae45236000 going to sleep for 11 seconds 00000100:00100000:3.0:1787579921.051225:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262755712 00000100:00100000:3.0:1787579921.051231:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262755712 00000100:00100000:3.0:1787579921.051269:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787579921.051278:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+17:5850:x1874413262755712:12345-0@lo:256: 20000000:01000000:3.0:1787579921.051295:0:5848:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787579921.051325:0:5848:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787579921.051328:0:5848:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1787579921.051425:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+17:5850:x1874413262755712:12345-0@lo:256: Request processed in 149us (789us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579921.051539:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae74638380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262755712:0@lo:256: 10000000:01000000:2.0:1787579921.051587:0:5850:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787579921.051595:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae4150f200/0xc86deac208337661 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208337668 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579921.051604:0:5850:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff8fae4150f200/0xc86deac208337661 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208337668 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787579921.051615:0:5850:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1787579921.051617:0:5850:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1787579921.051621:0:5850:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00000100:00100000:3.0:1787579921.051727:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00010000:00010000:2.0:1787579921.052196:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae41660a00/0xc86deac20833766f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579921.052205:0:5850:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff8fae41660a00/0xc86deac20833766f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579921.052215:0:5850:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff8fae41660a00/0xc86deac20833766f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579921.052242:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae74638380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262755840:0@lo:101: 00000100:00100000:2.0:1787579921.052277:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579921.052298:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae45236000 going to sleep for 11 seconds 00000100:00100000:2.0:1787579921.052325:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262755840 00000100:00100000:2.0:1787579921.052329:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262755840 00000100:00100000:2.0:1787579921.052360:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787579921.052368:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+17:5850:x1874413262755840:12345-0@lo:101: 00010000:00010000:2.0:1787579921.052377:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787579921.052408:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fae41660200/0xc86deac208337676 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc86deac20833766f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579921.052705:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fae41660200/0xc86deac208337676 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc86deac20833766f expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579921.052719:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fae41660200/0xc86deac208337676 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac20833766f expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579921.052729:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae41660200, rc 0) 00000100:00100000:2.0:1787579921.052801:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+18:5850:x1874413262755840:12345-0@lo:101: Request processed in 434us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579921.052807:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787579921.061693:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae74638380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262755840:0@lo:101: 00010000:00010000:0.0:1787579921.061726:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff8fae41660a00/0xc86deac20833766f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208337676 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579921.061739:0:5850:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff8fae41660a00/0xc86deac20833766f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc86deac208337676 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579921.061839:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7f5baa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262755968:0@lo:501: 00000100:00100000:0.0:1787579921.061905:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579921.061956:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae77a32180 going to sleep for 11 seconds 00000100:00100000:0.0:1787579921.062816:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262755968 00000100:00100000:0.0:1787579921.062825:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262755968 00000100:00100000:0.0:1787579921.062880:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787579921.062891:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+18:5850:x1874413262755968:12345-0@lo:501: 00000100:00100000:0.0:1787579921.063252:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+18:5850:x1874413262755968:12345-0@lo:501: Request processed in 362us (1346us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579921.063261:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787579921.063322:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7f5baa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262755968:0@lo:501: 00000100:00100000:0.0:1787579921.063360:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7f5baa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262756096:0@lo:503: 00000100:00100000:0.0:1787579921.063423:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579921.064750:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae77a32180 going to sleep for 11 seconds 00000100:00100000:0.0:1787579921.064781:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262756096 00000100:00100000:0.0:1787579921.064788:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262756096 00000100:00100000:0.0:1787579921.064835:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787579921.064843:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+18:5850:x1874413262756096:12345-0@lo:503: 00000100:00100000:0.0:1787579921.065981:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+18:5850:x1874413262756096:12345-0@lo:503: Request processed in 1133us (2551us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579921.065992:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787579921.066229:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7f5baa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262756096:0@lo:503: 00000100:00100000:1.0:1787579921.071018:0:7998:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae48c90000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:7998:1874413262756224:0@lo:502: 00000100:00100000:1.0:1787579921.071109:0:7998:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579921.071257:0:7998:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae48760900 going to sleep for 11 seconds 00000100:00100000:0.0:1787579921.075255:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262756224 00000100:00100000:0.0:1787579921.075274:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262756224 00000100:00100000:1.0:1787579921.076252:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787579921.076269:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+18:7998:x1874413262756224:12345-0@lo:502: 00000100:00100000:1.0:1787579921.077325:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+18:7998:x1874413262756224:12345-0@lo:502: Request processed in 1054us (6210us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579921.081988:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787579921.082089:0:7998:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae48c90000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:7998:1874413262756224:0@lo:502: 00000020:01000000:1.0:1787579921.082514:0:7998:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787579921.082523:0:7998:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1787579921.082532:0:7998:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787579921.082534:0:7998:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1787579921.082547:0:7998:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787579921.082552:0:7998:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.136@tcp to nid 0x20000c0a8ca88 (192.168.202.136@tcp) 00000020:01000000:1.0:1787579921.082580:0:7998:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787579921.082583:0:7998:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787579921.082599:0:7998:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8fae5031b370) 00000020:00000080:1.0:1787579921.082621:0:7998:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1787579921.082627:0:7998:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787579921.083063:0:7998:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1787579921.083070:0:7998:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:1.0:1787579921.083092:0:7998:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc86deac208337684 00010000:00080000:1.0:1787579921.083536:0:7998:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8fad41109000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.136@tcp at head 00010000:00010000:1.0:1787579921.084334:0:7998:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:1.0:1787579921.085364:0:7998:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1787579921.085379:0:7998:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1787579921.086975:0:7998:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787579921.088589:0:7998:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787579921.088741:0:7998:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1787579921.088813:0:7998:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1787579921.094104:0:8000:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787579921.094114:0:8000:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1787579921.107054:0:7998:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787579921.107074:0:7998:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787579921.107144:0:7998:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1787579921.107177:0:7998:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc86deac20833768b 00000100:00080000:0.0:1787579921.107190:0:7998:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787579921.107198:0:7998:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8fad41109000 using connection 192.168.202.136@tcp/0@lo 00000100:00100000:0.0:1787579921.107376:0:7998:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fae7f5b8e00 x1874413262756352/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787579921.107436:0:7998:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1787579921.107510:0:7998:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787579921.107514:0:7998:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787579921.107517:0:7998:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1787579921.107520:0:7998:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787579921.107525:0:7998:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787579921.107526:0:7998:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787579921.107529:0:7998:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787579921.107531:0:7998:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787579921.107564:0:7998:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7f5b8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:7998:1874413262756480:0@lo:502: 00000100:00100000:0.0:1787579921.107664:0:7998:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579921.107703:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262756480 00000100:00100000:0.0:1787579921.107710:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262756480 00000100:00100000:0.0:1787579921.107752:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787579921.107761:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+18:7998:x1874413262756480:12345-0@lo:502: 00000100:00100000:0.0:1787579921.107996:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+18:7998:x1874413262756480:12345-0@lo:502: Request processed in 234us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579921.108005:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787579921.108066:0:7998:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae77a323c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787579921.108089:0:7998:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7f5b8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:7998:1874413262756480:0@lo:502: 00000020:01000000:0.0:1787579921.108115:0:7998:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787579921.108120:0:7998:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000100:00100000:1.0:1787579921.108830:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae48c90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874413262756608:0@lo:400: 00000100:00100000:1.0:1787579921.108873:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579921.108920:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae48c90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874413262756736:0@lo:400: 00000100:00100000:1.0:1787579921.108946:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579921.108964:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787579921.108969:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae48c92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874413262756864:0@lo:400: 00000100:00100000:1.0:1787579921.108990:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579921.109019:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262756608 00000100:00100000:1.0:1787579921.109025:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262756608 00000100:00100000:1.0:1787579921.109057:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262756736 00000100:00100000:1.0:1787579921.109060:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262756736 00000100:00100000:1.0:1787579921.109091:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262756864 00000100:00100000:1.0:1787579921.109105:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262756864 00000100:00100000:3.0:1787579921.109538:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787579921.109550:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874413262756608:12345-0@lo:400: 00000100:00100000:3.0:1787579921.109604:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874413262756608:12345-0@lo:400: Request processed in 57us (731us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579921.109611:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787579921.109628:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787579921.109635:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874413262756736:12345-0@lo:400: 00000020:00000080:0.0:1787579921.109744:0:7998:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787579921.109761:0:7998:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000100:00100000:2.0:1787579921.109810:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7f5b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1874413262756352:0@lo:8: 00000020:01000000:0.0:1787579921.109823:0:5850:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1787579921.109840:0:5850:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00000100:00100000:2.0:1787579921.109847:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787579921.109850:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae41660a00/0xc86deac20833766f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208337676 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579921.109860:0:5850:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff8fae41660a00/0xc86deac20833766f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208337676 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787579921.109869:0:5850:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787579921.109872:0:5850:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8fae503119b8 from 1 10000000:01000000:0.0:1787579921.109874:0:5850:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00000100:00080000:2.0:1787579921.109883:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787579921.109903:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae50feb000/0xc86deac208337692 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579921.109910:0:5850:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff8fae50feb000/0xc86deac208337692 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579921.109921:0:5850:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff8fae50feb000/0xc86deac208337692 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579921.109934:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7f5b8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262756992:0@lo:101: 00000100:00100000:0.0:1787579921.109963:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579921.109979:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae77a323c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787579921.110053:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262756352 00000100:00100000:2.0:1787579921.110063:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262756352 00000100:00100000:2.0:1787579921.110095:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787579921.110101:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74638700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3313:x1874413262756352:12345-0@lo:8: 00000100:00100000:3.0:1787579921.110105:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874413262756736:12345-0@lo:400: Request processed in 471us (1159us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579921.110111:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:2.0:1787579921.110122:0:6705:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 268 last 0 00000020:00000080:2.0:1787579921.110149:0:6705:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc86deac208337699 00002000:00100000:2.0:1787579921.110165:0:6705:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8fae5ff38800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113950 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1787579921.110170:0:6705:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:2.0:1787579921.110173:0:6705:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1787579921.110313:0:6705:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787579921.110490:0:6705:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787579921.110619:0:6705:0:(import.c:65:import_set_state_nolock()) ffff8fae5ff3d800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787579921.110641:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787579921.110665:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874413262756864:12345-0@lo:400: 00000100:00100000:2.0:1787579921.110665:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74638700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3313:x1874413262756352:12345-0@lo:8: Request processed in 562us (815us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579921.110671:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787579921.110697:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874413262756864:12345-0@lo:400: Request processed in 36us (1706us total) trans 0 rc 0/0 00010000:00080000:2.0:1787579921.110780:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae7f5b8e00 x1874413262756352/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787579931 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787579921.110792:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787579921.110800:0:3313:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1787579921.110807:0:3313:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787579921.110812:0:3313:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1787579921.110815:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8fad41109000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787579921.110872:0:3313:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787579921.110879:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7f5b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1874413262756352:0@lo:8: 00000004:00080000:2.0:1787579921.110903:0:8000:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787579921.111031:0:8000:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 268866646448ns, next at 0ns, rc = 0 00000100:00100000:1.0:1787579921.111083:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262756992 00000100:00100000:1.0:1787579921.111090:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262756992 00000100:00100000:2.0:1787579921.111159:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787579921.111168:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+18:5850:x1874413262756992:12345-0@lo:101: 00010000:00010000:2.0:1787579921.111185:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787579921.111200:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fae41660e00/0xc86deac2083376a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xc86deac208337692 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579921.111223:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fae41660e00/0xc86deac2083376a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc86deac208337692 expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579921.111235:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fae41660e00/0xc86deac2083376a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac208337692 expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579921.111243:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae41660e00, rc 0) 00000100:00100000:2.0:1787579921.111275:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:5850:x1874413262756992:12345-0@lo:101: Request processed in 109us (1311us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579921.111281:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787579921.111325:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7f5b8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262756992:0@lo:101: 00010000:00010000:2.0:1787579921.111339:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff8fae50feb000/0xc86deac208337692 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac2083376a0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579921.111349:0:5850:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff8fae50feb000/0xc86deac208337692 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc86deac2083376a0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579921.111415:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae74638380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262757120:0@lo:501: 00000100:00100000:2.0:1787579921.111443:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579921.111466:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae45236000 going to sleep for 11 seconds 00000100:00100000:2.0:1787579921.111477:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262757120 00000100:00100000:2.0:1787579921.111480:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262757120 00000100:00100000:2.0:1787579921.111502:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787579921.111509:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:5850:x1874413262757120:12345-0@lo:501: 00000100:00100000:2.0:1787579921.111889:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:5850:x1874413262757120:12345-0@lo:501: Request processed in 378us (443us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787579921.111897:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787579921.112415:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae74638380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262757120:0@lo:501: 10000000:01000000:2.0:1787579921.112442:0:5850:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787579921.112449:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae50feb000/0xc86deac208337692 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac2083376a0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579921.112458:0:5850:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff8fae50feb000/0xc86deac208337692 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac2083376a0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579921.112862:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:3.0:1787579921.112915:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae48c90000 x1874413262756608/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787579937 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787579921.112927:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae48c90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874413262756608:0@lo:400: 00010000:00080000:2.0:1787579921.112946:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae48c92a00 x1874413262756864/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787579937 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787579921.112956:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae48c92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874413262756864:0@lo:400: 00010000:00080000:2.0:1787579921.112968:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae48c90700 x1874413262756736/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787579937 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787579921.112975:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae48c90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874413262756736:0@lo:400: 00000004:00080000:2.0:1787579921.196307:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:0.0:1787579921.290583:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000004:00080000:2.0:1787579921.290665:0:8001:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1787579921.290711:0:8001:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae77aa8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8001:1874413262757376:0@lo:7: 00000100:00100000:2.0:1787579921.290789:0:8001:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579921.290838:0:8001:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae50eda180 going to sleep for 11 seconds 00000100:00100000:2.0:1787579921.290859:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262757376 00000100:00100000:2.0:1787579921.290866:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262757376 00000100:00100000:2.0:1787579921.290923:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787579921.290933:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae77aa8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8001:x1874413262757376:12345-0@lo:7: 00000100:00100000:0.0:1787579921.298575:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae74638380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874413262757248:0@lo:13: 00000100:00100000:0.0:1787579921.299574:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579921.300006:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262757248 00000100:00100000:1.0:1787579921.300015:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262757248 00000100:00100000:1.0:1787579921.300075:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787579921.300086:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7f5bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3317:x1874413262757248:12345-0@lo:13: 00002000:00000024:1.0:1787579921.300121:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1787579921.300183:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7f5bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3317:x1874413262757248:12345-0@lo:13: Request processed in 98us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579921.300191:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1787579921.300236:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae74638380 x1874413262757248/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787579937 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787579921.300256:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae74638380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874413262757248:0@lo:13: 00000100:00080000:0.0:1787579921.300521:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:2.0:1787579921.318791:0:6708:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1787579921.318801:0:6708:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1787579921.318903:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae77aa8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8001:x1874413262757376:12345-0@lo:7: Request processed in 27965us (28107us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579921.318916:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1787579921.318970:0:8001:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae77aa8700 x1874413262757376/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787579937 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787579921.318987:0:8001:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae77aa8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8001:1874413262757376:0@lo:7: 00000004:00080000:2.0:1787579921.319001:0:8001:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:2.0:1787579921.319039:0:8001:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae77aa8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8001:1874413262757504:0@lo:5: 00000100:00100000:2.0:1787579921.319078:0:8001:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579921.319119:0:8001:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae50eda180 going to sleep for 11 seconds 00000100:00100000:2.0:1787579921.321378:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262757504 00000100:00100000:2.0:1787579921.321415:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262757504 00000100:00100000:2.0:1787579921.321557:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787579921.321569:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae77aa8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8001:x1874413262757504:12345-0@lo:5: 00002000:00080000:2.0:1787579921.321606:0:6705:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1787579921.321611:0:6705:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1787579921.321969:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae77aa8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:8001:x1874413262757504:12345-0@lo:5: Request processed in 401us (2889us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1787579921.321977:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1787579921.322033:0:8001:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae77aa8700 x1874413262757504/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787579937 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787579921.322052:0:8001:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae77aa8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8001:1874413262757504:0@lo:5: 00000004:00080000:2.0:1787579921.322066:0:8001:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:2.0:1787579921.322107:0:8001:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae77aa9880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8001:1874413262757632:0@lo:700: 00000100:00100000:2.0:1787579921.322154:0:8001:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579921.322174:0:8001:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae50eda180 going to sleep for 11 seconds 00000100:00100000:2.0:1787579921.322189:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262757632 00000100:00100000:2.0:1787579921.322193:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262757632 00000100:00100000:2.0:1787579921.322238:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787579921.322245:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae77aa8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8001:x1874413262757632:12345-0@lo:700: 00000100:00100000:2.0:1787579921.322273:0:6714:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae77aab480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6714:1874413262757760:0@lo:700: 00000100:00100000:2.0:1787579921.322310:0:6714:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579921.322326:0:6714:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae50edaf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787579921.322345:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262757760 00000100:00100000:2.0:1787579921.322348:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262757760 00000100:00100000:2.0:1787579921.322379:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787579921.322403:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae77aa9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6714:x1874413262757760:12345-0@lo:700: 40000000:02000000:2.0:1787579921.416143:0:5859:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:3.0:1787579921.424952:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae77aa9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6714:x1874413262757760:12345-0@lo:700: Request processed in 102540us (102632us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579921.424967:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787579921.425212:0:6714:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae77aab480 x1874413262757760/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787579937 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787579921.425230:0:6714:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae77aab480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6714:1874413262757760:0@lo:700: 40000000:02000000:2.0:1787579921.425244:0:6714:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:1.0:1787579921.480788:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:1.0:1787579921.480808:0:7653:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1787579921.480947:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae77aa8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8001:x1874413262757632:12345-0@lo:700: Request processed in 158697us (158788us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579921.480959:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787579921.481008:0:8001:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae77aa9880 x1874413262757632/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787579937 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787579921.481019:0:8001:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1787579921.481036:0:8001:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae77aa9880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8001:1874413262757632:0@lo:700: 00000004:02000040:3.0:1787579921.535335:0:8001:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:3.0:1787579921.542975:0:8001:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5f4af100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8001:1874413262757888:0@lo:5: 00000100:00100000:3.0:1787579921.543046:0:8001:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579921.543103:0:8001:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae455a9480 going to sleep for 11 seconds 00000100:00100000:0.0:1787579921.548458:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262757888 00000100:00100000:0.0:1787579921.548471:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262757888 00000100:00100000:0.0:1787579921.548529:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787579921.548549:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5f4ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8001:x1874413262757888:12345-0@lo:5: 00002000:00080000:1.0:1787579921.559667:0:6705:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1787579921.559688:0:6705:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:1.0:1787579921.575327:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5f4ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8001:x1874413262757888:12345-0@lo:5: Request processed in 26768us (32266us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1787579921.575377:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1787579921.575576:0:8001:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae5f4af100 x1874413262757888/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787579937 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787579921.575598:0:8001:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5f4af100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8001:1874413262757888:0@lo:5: 00000004:00080000:3.0:1787579921.575615:0:8001:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:3.0:1787579921.920963:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787579922.933542:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787579923.978537:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579924.981518:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787579925.624050:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7f5b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874413262758016:0@lo:13: 00000100:00100000:0.0:1787579925.624124:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579925.624189:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262758016 00000100:00100000:0.0:1787579925.624195:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262758016 00000100:00100000:0.0:1787579925.624249:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787579925.624268:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7f5b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874413262758016:12345-0@lo:13: 00002000:00000024:0.0:1787579925.624306:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787579925.624366:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7f5b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874413262758016:12345-0@lo:13: Request processed in 109us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579925.624373:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1787579925.624411:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787579925.624447:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae7f5b8000 x1874413262758016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787579941 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787579925.624467:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7f5b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874413262758016:0@lo:13: 00000001:00080000:1.0:1787579925.637946:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:0.0:1787579925.956203:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787579925.956285:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239664768 00000100:00100000:2.0:1787579925.956296:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239664768 00000100:00100000:2.0:1787579925.956344:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 114 00000100:00100000:2.0:1787579925.956354:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2357:x1874413239664768:12345-192.168.202.36@tcp:250: 00010000:00080000:2.0:1787579925.956442:0:5845:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 7ff68ada-0c43-4367-93b7-ad31684360cf@192.168.202.36@tcp t0 exp 0000000000000000 cur 273 last 0 00000020:00000080:2.0:1787579925.956472:0:5845:0:(genops.c:1385:class_connect()) connect: client 7ff68ada-0c43-4367-93b7-ad31684360cf, cookie 0xc86deac2083376a7 00000100:00080000:2.0:1787579925.956610:0:5845:0:(import.c:65:import_set_state_nolock()) ffff8fae5ff38000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787579925.956686:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ff68ada-0c43-4367-93b7-ad31684360cf+5:2357:x1874413239664768:12345-192.168.202.36@tcp:250: Request processed in 320us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579925.956694:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 114 00000100:00100000:3.0:1787579925.961225:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787579925.961322:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239664896 00000100:00100000:2.0:1787579925.961341:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239664896 00000100:00100000:2.0:1787579925.961417:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 115 00000100:00100000:2.0:1787579925.961427:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ff68ada-0c43-4367-93b7-ad31684360cf+5:5589:x1874413239664896:12345-192.168.202.36@tcp:101: 00010000:00010000:2.0:1787579925.961445:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787579925.961463:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fae41660600/0xc86deac2083376ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xf454739e86a9cf7f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579925.961494:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fae41660600/0xc86deac2083376ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9cf7f expref: 6 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579925.961505:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fae41660600/0xc86deac2083376ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9cf7f expref: 6 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579925.961515:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae41660600, rc 0) 00000100:00100000:2.0:1787579925.961572:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ff68ada-0c43-4367-93b7-ad31684360cf+6:5589:x1874413239664896:12345-192.168.202.36@tcp:101: Request processed in 146us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579925.961596:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 115 00000100:00100000:2.0:1787579925.963471:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787579925.963517:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239665024 00000100:00100000:3.0:1787579925.963526:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239665024 00000100:00100000:3.0:1787579925.963576:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 116 00000100:00100000:3.0:1787579925.963586:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae487de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ff68ada-0c43-4367-93b7-ad31684360cf+6:5589:x1874413239665024:12345-192.168.202.36@tcp:501: 00000100:00100000:3.0:1787579925.966031:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae487de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ff68ada-0c43-4367-93b7-ad31684360cf+6:5589:x1874413239665024:12345-192.168.202.36@tcp:501: Request processed in 2435us (2555us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787579925.966046:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 116 00000100:00100000:3.0:1787579925.973673:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787579925.982005:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239665152 00000100:00100000:1.0:1787579925.982023:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239665152 00000100:00100000:1.0:1787579925.982141:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 117 00000100:00100000:1.0:1787579925.982152:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae487df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ff68ada-0c43-4367-93b7-ad31684360cf+6:5589:x1874413239665152:12345-192.168.202.36@tcp:101: 00010000:00010000:1.0:1787579925.982188:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787579925.982206:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fae4ca58c00/0xc86deac2083376b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xf454739e86a9cf86 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579925.982235:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fae4ca58c00/0xc86deac2083376b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9cf86 expref: 7 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579925.982246:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fae4ca58c00/0xc86deac2083376b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9cf86 expref: 7 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579925.982266:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae4ca58c00, rc 0) 00000100:00100000:1.0:1787579925.982345:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae487df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ff68ada-0c43-4367-93b7-ad31684360cf+7:5589:x1874413239665152:12345-192.168.202.36@tcp:101: Request processed in 186us (8675us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579925.982353:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 117 00000100:00100000:3.0:1787579926.003696:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787579926.003917:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239665280 00000100:00100000:0.0:1787579926.003928:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239665280 00000100:00100000:0.0:1787579926.003984:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 118 00000100:00100000:0.0:1787579926.003994:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae487dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ff68ada-0c43-4367-93b7-ad31684360cf+7:5589:x1874413239665280:12345-192.168.202.36@tcp:501: 00000100:00100000:0.0:1787579926.005242:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae487dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ff68ada-0c43-4367-93b7-ad31684360cf+8:5589:x1874413239665280:12345-192.168.202.36@tcp:501: Request processed in 1242us (1550us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579926.005254:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 118 00010000:00010000:0.0:1787579926.005344:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787579926.007588:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787579926.009364:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239665408 00000100:00100000:1.0:1787579926.009380:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239665408 00000100:00100000:1.0:1787579926.009467:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 119 00000100:00100000:1.0:1787579926.009479:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae487ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ff68ada-0c43-4367-93b7-ad31684360cf+8:5589:x1874413239665408:12345-192.168.202.36@tcp:503: 00000100:00100000:1.0:1787579926.009898:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae487ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ff68ada-0c43-4367-93b7-ad31684360cf+8:5589:x1874413239665408:12345-192.168.202.36@tcp:503: Request processed in 419us (2317us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579926.009906:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 119 00000100:00100000:3.0:1787579926.022724:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787579926.026517:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239665536 00000100:00100000:0.0:1787579926.026540:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239665536 00000100:00100000:0.0:1787579926.026605:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 120 00000100:00100000:0.0:1787579926.026616:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae487df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ff68ada-0c43-4367-93b7-ad31684360cf+8:5608:x1874413239665536:12345-192.168.202.36@tcp:502: 00000100:00100000:0.0:1787579926.027356:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae487df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ff68ada-0c43-4367-93b7-ad31684360cf+8:5608:x1874413239665536:12345-192.168.202.36@tcp:502: Request processed in 738us (4642us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579926.027366:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 120 00000100:00100000:3.0:1787579926.058532:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787579926.059591:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239665664 00000100:00100000:0.0:1787579926.059604:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239665664 00000100:00100000:0.0:1787579926.059668:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 121 00000100:00100000:0.0:1787579926.059679:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae487dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ff68ada-0c43-4367-93b7-ad31684360cf+8:5608:x1874413239665664:12345-192.168.202.36@tcp:502: 00000100:00100000:0.0:1787579926.060021:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae487dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ff68ada-0c43-4367-93b7-ad31684360cf+8:5608:x1874413239665664:12345-192.168.202.36@tcp:502: Request processed in 342us (1499us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579926.060031:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 121 00000100:00100000:1.0:1787579926.069841:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787579926.070119:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239665792 00000100:00100000:2.0:1787579926.070131:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239665792 00000100:00100000:2.0:1787579926.070188:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 122 00000100:00100000:2.0:1787579926.070199:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae487dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ff68ada-0c43-4367-93b7-ad31684360cf+8:5589:x1874413239665792:12345-192.168.202.36@tcp:101: 00010000:00010000:2.0:1787579926.070217:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787579926.070236:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fae41660400/0xc86deac2083376bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf454739e86a9cfb0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579926.070278:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fae41660400/0xc86deac2083376bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9cfb0 expref: 9 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579926.070300:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fae41660400/0xc86deac2083376bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9cfb0 expref: 9 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579926.070309:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae41660400, rc 0) 00000100:00100000:2.0:1787579926.070373:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae487dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ff68ada-0c43-4367-93b7-ad31684360cf+9:5589:x1874413239665792:12345-192.168.202.36@tcp:101: Request processed in 175us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579926.070413:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 122 00000100:00100000:3.0:1787579926.083581:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787579926.083749:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239665920 00000100:00100000:1.0:1787579926.083761:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239665920 00000100:00100000:1.0:1787579926.083847:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 123 00000100:00100000:1.0:1787579926.083859:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae487dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ff68ada-0c43-4367-93b7-ad31684360cf+9:5589:x1874413239665920:12345-192.168.202.36@tcp:256: 20000000:01000000:1.0:1787579926.083898:0:5847:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787579926.083933:0:5847:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787579926.083937:0:5847:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787579926.083940:0:5847:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787579926.083942:0:5847:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1787579926.093527:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae487dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ff68ada-0c43-4367-93b7-ad31684360cf+9:5589:x1874413239665920:12345-192.168.202.36@tcp:256: Request processed in 9658us (9947us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579926.093544:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 123 00000100:00100000:1.0:1787579926.100352:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787579926.101911:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239666048 00000100:00100000:2.0:1787579926.101923:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239666048 00000100:00100000:2.0:1787579926.101981:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 124 00000100:00100000:2.0:1787579926.101994:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae487dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ff68ada-0c43-4367-93b7-ad31684360cf+9:5589:x1874413239666048:12345-192.168.202.36@tcp:101: 00010000:00010000:2.0:1787579926.102011:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787579926.102047:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fae74ed9c00/0xc86deac2083376c3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf454739e86a9cfb7 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579926.102103:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fae74ed9c00/0xc86deac2083376c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9cfb7 expref: 10 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579926.102116:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fae74ed9c00/0xc86deac2083376c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9cfb7 expref: 10 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579926.102127:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae74ed9c00, rc 0) 00000100:00100000:2.0:1787579926.102188:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae487dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ff68ada-0c43-4367-93b7-ad31684360cf+10:5589:x1874413239666048:12345-192.168.202.36@tcp:101: Request processed in 197us (1848us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579926.102195:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 124 00000100:00100000:2.0:1787579926.105073:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787579926.105117:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239666176 00000100:00100000:2.0:1787579926.105126:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239666176 00000100:00100000:2.0:1787579926.105164:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 125 00000100:00100000:2.0:1787579926.105172:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae487dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ff68ada-0c43-4367-93b7-ad31684360cf+10:5589:x1874413239666176:12345-192.168.202.36@tcp:501: 00000100:00100000:2.0:1787579926.107221:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae487dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ff68ada-0c43-4367-93b7-ad31684360cf+10:5589:x1874413239666176:12345-192.168.202.36@tcp:501: Request processed in 2038us (2146us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579926.107234:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 125 00000100:00100000:1.0:1787579926.109907:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787579926.110112:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239666304 00000100:00100000:0.0:1787579926.110123:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239666304 00000100:00100000:0.0:1787579926.110178:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 126 00000100:00100000:0.0:1787579926.110189:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae52127450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ff68ada-0c43-4367-93b7-ad31684360cf+10:5589:x1874413239666304:12345-192.168.202.36@tcp:503: 00000100:00100000:0.0:1787579926.110654:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae52127450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ff68ada-0c43-4367-93b7-ad31684360cf+10:5589:x1874413239666304:12345-192.168.202.36@tcp:503: Request processed in 465us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579926.110663:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 126 00000100:00100000:1.0:1787579926.122903:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787579926.123109:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239666432 00000100:00100000:0.0:1787579926.123122:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239666432 00000100:00100000:0.0:1787579926.123190:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 127 00000100:00100000:0.0:1787579926.123216:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae52126850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ff68ada-0c43-4367-93b7-ad31684360cf+10:5612:x1874413239666432:12345-192.168.202.36@tcp:502: 00000100:00100000:0.0:1787579926.123507:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae52126850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ff68ada-0c43-4367-93b7-ad31684360cf+10:5612:x1874413239666432:12345-192.168.202.36@tcp:502: Request processed in 291us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579926.123515:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 127 00000100:00100000:1.0:1787579926.131584:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae48c92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3314:1874413262758144:0@lo:400: 00000100:00100000:1.0:1787579926.131670:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579926.131742:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae48c90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874413262758656:0@lo:400: 00000100:00100000:1.0:1787579926.131778:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579926.131816:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787579926.131822:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae48c92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874413262758272:0@lo:400: 00000100:00100000:1.0:1787579926.131849:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579926.131877:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae48c90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874413262758400:0@lo:400: 00000100:00100000:1.0:1787579926.131918:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579926.131940:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787579926.131946:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae48c92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1874413262758528:0@lo:400: 00000100:00100000:1.0:1787579926.131969:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579926.132003:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262758144 00000100:00100000:1.0:1787579926.132011:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262758144 00000100:00100000:1.0:1787579926.132059:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787579926.132069:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:3314:x1874413262758144:12345-0@lo:400: 00000100:00100000:1.0:1787579926.132121:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:3314:x1874413262758144:12345-0@lo:400: Request processed in 53us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579926.132128:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787579926.132161:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262758656 00000100:00100000:1.0:1787579926.132170:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262758656 00000100:00100000:1.0:1787579926.132222:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787579926.132228:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874413262758656:12345-0@lo:400: 00000100:00100000:1.0:1787579926.132298:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874413262758656:12345-0@lo:400: Request processed in 70us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579926.132304:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787579926.132322:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262758272 00000100:00100000:1.0:1787579926.132326:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262758272 00000100:00100000:1.0:1787579926.132343:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262758400 00000100:00100000:1.0:1787579926.132345:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262758400 00000100:00100000:1.0:1787579926.132356:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262758528 00000100:00100000:1.0:1787579926.132358:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262758528 00000100:00100000:1.0:1787579926.132370:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787579926.132376:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74638380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874413262758272:12345-0@lo:400: 00000100:00100000:1.0:1787579926.132433:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74638380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874413262758272:12345-0@lo:400: Request processed in 56us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579926.132439:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787579926.132449:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787579926.132455:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7f35c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874413262758400:12345-0@lo:400: 00000100:00100000:1.0:1787579926.132483:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7f35c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874413262758400:12345-0@lo:400: Request processed in 28us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579926.132488:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787579926.132498:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787579926.132505:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7f35f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874413262758528:12345-0@lo:400: 00000100:00100000:1.0:1787579926.132529:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7f35f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874413262758528:12345-0@lo:400: Request processed in 24us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579926.132534:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:1.0:1787579926.132557:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787579926.132568:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787579926.132599:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae48c92a00 x1874413262758528/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787579942 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787579926.132613:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae48c92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1874413262758528:0@lo:400: 00010000:00080000:1.0:1787579926.132624:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae48c90700 x1874413262758400/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787579942 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787579926.132632:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae48c90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874413262758400:0@lo:400: 00010000:00080000:1.0:1787579926.132662:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae48c92d80 x1874413262758272/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787579942 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787579926.132671:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae48c92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874413262758272:0@lo:400: 00000100:00100000:1.0:1787579926.132681:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae48c92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3314:1874413262758144:0@lo:400: 00010000:00080000:1.0:1787579926.132690:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae48c90000 x1874413262758656/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787579942 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787579926.132696:0:3314:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1787579926.132705:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae48c90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874413262758656:0@lo:400: 00000100:00100000:1.0:1787579926.137353:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787579926.137408:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239666560 00000100:00100000:1.0:1787579926.137418:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239666560 00000100:00100000:1.0:1787579926.137461:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 129 00000100:00100000:1.0:1787579926.137470:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ff68ada-0c43-4367-93b7-ad31684360cf+10:5612:x1874413239666560:12345-192.168.202.36@tcp:502: 00000100:00100000:1.0:1787579926.137672:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ff68ada-0c43-4367-93b7-ad31684360cf+10:5612:x1874413239666560:12345-192.168.202.36@tcp:502: Request processed in 203us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579926.137681:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 129 00000100:00100000:1.0:1787579926.145781:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787579926.145923:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239666688 00000100:00100000:1.0:1787579926.145934:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239666688 00000100:00100000:1.0:1787579926.145971:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 4 00000100:00100000:1.0:1787579926.145979:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7f35d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2357:x1874413239666688:12345-192.168.202.36@tcp:38: 00010000:00080000:1.0:1787579926.146012:0:5853:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 31d1df27-21ab-4c76-bd19-e53fa778bd7e@192.168.202.36@tcp t0 exp 0000000000000000 cur 273 last 0 00000020:00000080:1.0:1787579926.146058:0:5853:0:(genops.c:1385:class_connect()) connect: client 31d1df27-21ab-4c76-bd19-e53fa778bd7e, cookie 0xc86deac2083376ca 00000004:00100000:1.0:1787579926.146102:0:5853:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1787579926.146109:0:5853:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:0.0:1787579926.170445:0:5853:0:(import.c:65:import_set_state_nolock()) ffff8fae6d1e7800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787579926.170519:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7f35d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:2357:x1874413239666688:12345-192.168.202.36@tcp:38: Request processed in 24538us (24744us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579926.170530:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 4 00000100:00100000:1.0:1787579926.653503:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5f4ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874413262758784:0@lo:13: 00000100:00100000:1.0:1787579926.653575:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579926.656830:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262758784 00000100:00100000:3.0:1787579926.656845:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262758784 00000100:00100000:3.0:1787579926.656913:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787579926.656923:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7f35fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874413262758784:12345-0@lo:13: 00002000:00000024:3.0:1787579926.656961:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787579926.657042:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7f35fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874413262758784:12345-0@lo:13: Request processed in 121us (3467us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579926.657048:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1787579926.658659:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae5f4ac700 x1874413262758784/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787579942 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787579926.658687:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5f4ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874413262758784:0@lo:13: 00010000:00010000:2.0:1787579927.027679:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787579927.182945:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787579927.183034:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239666816 00000100:00100000:3.0:1787579927.183044:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239666816 00000100:00100000:3.0:1787579927.183141:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 5 00000100:00100000:3.0:1787579927.183153:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7f35ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:0:x1874413239666816:12345-192.168.202.36@tcp:41: 00000004:00000024:3.0:1787579927.183203:0:5852:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1787579927.183314:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7f35ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:0:x1874413239666816:12345-192.168.202.36@tcp:41: Request processed in 162us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579927.183322:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 5 00000100:00080000:1.0:1787579927.183554:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787579927.183927:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787579927.183987:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239666944 00000100:00100000:0.0:1787579927.183994:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239666944 00000100:00100000:0.0:1787579927.184049:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 6 00000100:00100000:0.0:1787579927.184060:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae77aa9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:5589:x1874413239666944:12345-192.168.202.36@tcp:41: 00000004:00000024:0.0:1787579927.184079:0:5853:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1787579927.190703:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae77aa9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:5589:x1874413239666944:12345-192.168.202.36@tcp:41: Request processed in 6624us (6756us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579927.190722:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 6 00000100:00100000:2.0:1787579927.199871:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787579927.199933:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239667072 00000100:00100000:3.0:1787579927.199947:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239667072 00000100:00100000:3.0:1787579927.200023:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 7 00000100:00100000:3.0:1787579927.200049:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae77aa8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:5589:x1874413239667072:12345-192.168.202.36@tcp:40: 00000100:00100000:3.0:1787579927.200457:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae77aa8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:5589:x1874413239667072:12345-192.168.202.36@tcp:40: Request processed in 409us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579927.200466:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 7 00000100:00100000:1.0:1787579927.205468:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787579927.205516:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787579927.205778:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239667200 00000100:00100000:2.0:1787579927.205791:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239667200 00000100:00100000:2.0:1787579927.205843:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239667328 00000100:00100000:2.0:1787579927.205847:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239667328 00000100:00100000:2.0:1787579927.205865:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 8 00000100:00100000:2.0:1787579927.205877:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7f35f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2357:x1874413239667200:12345-192.168.202.36@tcp:8: 00010000:00080000:2.0:1787579927.205936:0:6705:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 31d1df27-21ab-4c76-bd19-e53fa778bd7e@192.168.202.36@tcp t0 exp 0000000000000000 cur 274 last 0 00000020:00000080:2.0:1787579927.205973:0:6705:0:(genops.c:1385:class_connect()) connect: client 31d1df27-21ab-4c76-bd19-e53fa778bd7e, cookie 0xc86deac2083376d1 00002000:00100000:2.0:1787579927.205990:0:6705:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 31d1df27-21ab-4c76-bd19-e53fa778bd7e/ffff8fae5ff39000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787579927.206005:0:6705:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787579927.206477:0:6705:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787579927.206516:0:6705:0:(import.c:65:import_set_state_nolock()) ffff8fae5ff3b000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787579927.208869:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7f35f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:2357:x1874413239667200:12345-192.168.202.36@tcp:8: Request processed in 2980us (3400us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579927.208884:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 8 00000100:00100000:2.0:1787579927.208924:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 9 00000100:00100000:2.0:1787579927.208932:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7f35f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2357:x1874413239667328:12345-192.168.202.36@tcp:8: 00010000:00080000:2.0:1787579927.208967:0:6705:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 31d1df27-21ab-4c76-bd19-e53fa778bd7e@192.168.202.36@tcp t0 exp 0000000000000000 cur 274 last 0 00000020:00000080:2.0:1787579927.209007:0:6705:0:(genops.c:1385:class_connect()) connect: client 31d1df27-21ab-4c76-bd19-e53fa778bd7e, cookie 0xc86deac2083376d8 00002000:00100000:2.0:1787579927.209023:0:6705:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 31d1df27-21ab-4c76-bd19-e53fa778bd7e/ffff8fae5ff3a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787579927.209038:0:6705:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787579927.209464:0:6705:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787579927.209503:0:6705:0:(import.c:65:import_set_state_nolock()) ffff8fae5ff3f000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787579927.215018:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787579927.218631:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7f35f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:2357:x1874413239667328:12345-192.168.202.36@tcp:8: Request processed in 9683us (13100us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579927.218650:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 9 00000100:00100000:3.0:1787579927.218920:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787579927.219258:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239667584 00000100:00100000:2.0:1787579927.219269:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239667584 00000100:00100000:2.0:1787579927.219320:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 130 00000100:00100000:2.0:1787579927.219329:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ff68ada-0c43-4367-93b7-ad31684360cf+10:2361:x1874413239667584:12345-192.168.202.36@tcp:400: 00000100:00100000:2.0:1787579927.219441:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ff68ada-0c43-4367-93b7-ad31684360cf+10:2361:x1874413239667584:12345-192.168.202.36@tcp:400: Request processed in 112us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579927.219448:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 130 00000100:00100000:0.0:1787579927.228472:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239667456 00000100:00100000:0.0:1787579927.228490:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239667456 00000100:00100000:0.0:1787579927.228563:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 0 00000100:00100000:0.0:1787579927.228576:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7f5b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:5589:x1874413239667456:12345-192.168.202.36@tcp:33: 00000004:00080000:0.0:1787579927.259417:0:5855:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 30761us 00000004:00200000:0.0:1787579927.280603:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1787579927.280789:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7f5b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:5589:x1874413239667456:12345-192.168.202.36@tcp:33: Request processed in 52209us (65775us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579927.280811:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 0 00000100:00100000:0.0:1787579927.562331:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787579927.562533:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239667712 00000100:00100000:1.0:1787579927.562544:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239667712 00000100:00100000:1.0:1787579927.562608:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 8 00000100:00100000:1.0:1787579927.562619:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7f5baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:5629:x1874413239667712:12345-192.168.202.36@tcp:101: 00010000:00010000:1.0:1787579927.562641:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787579927.562668:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59c00/0xc86deac2083376df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9cfe1 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579927.562742:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59000/0xc86deac2083376e6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579927.562782:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59000/0xc86deac2083376e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579927.562800:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59000/0xc86deac2083376e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787579927.563038:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1787579927.563044:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787579927.563140:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59000/0xc86deac2083376e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579927.563169:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59c00/0xc86deac2083376df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9cfe1 expref: 8 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579927.563188:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59000/0xc86deac2083376e6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9cfe1 expref: 7 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579927.563196:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fae5bb2f400) 00010000:00010000:1.0:1787579927.563199:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787579927.563203:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae4ca59000, rc 0) 00000100:00100000:1.0:1787579927.563276:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7f5baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+7:5629:x1874413239667712:12345-192.168.202.36@tcp:101: Request processed in 659us (957us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579927.563284:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 8 00010000:00010000:1.0:1787579928.055156:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579929.075924:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787579930.100296:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787579930.130044:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787579930.130254:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239667840 00000100:00100000:3.0:1787579930.130266:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239667840 00000100:00100000:3.0:1787579930.130358:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 9 00000100:00100000:3.0:1787579930.130371:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7f35d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+7:5681:x1874413239667840:12345-192.168.202.36@tcp:41: 00000004:00000024:3.0:1787579930.130470:0:5852:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1787579930.130569:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7f35d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+7:5681:x1874413239667840:12345-192.168.202.36@tcp:41: Request processed in 200us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579930.130578:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 9 00000100:00080000:1.0:1787579930.130823:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787579930.140620:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787579930.140732:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239667968 00000100:00100000:1.0:1787579930.140755:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239667968 00000100:00100000:1.0:1787579930.140835:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 10 00000100:00100000:1.0:1787579930.140860:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7f5b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:5681:x1874413239667968:12345-192.168.202.36@tcp:13: 00002000:00000024:1.0:1787579930.140917:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787579930.140988:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7f5b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:5681:x1874413239667968:12345-192.168.202.36@tcp:13: Request processed in 130us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579930.140996:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 10 00000100:00080000:0.0:1787579930.141306:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787579930.160556:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787579930.164702:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239668096 00000100:00100000:1.0:1787579930.164721:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239668096 00000100:00100000:1.0:1787579930.164819:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 11 00000100:00100000:1.0:1787579930.164830:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae77aab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:5681:x1874413239668096:12345-192.168.202.36@tcp:13: 00002000:00000024:1.0:1787579930.164871:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787579930.164973:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae77aab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:5681:x1874413239668096:12345-192.168.202.36@tcp:13: Request processed in 145us (4426us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579930.164982:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 11 00000100:00080000:0.0:1787579930.165809:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787579930.744209:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787579930.744265:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7f35ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874413262758912:0@lo:13: 00000100:00100000:0.0:1787579930.744337:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579930.744642:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262758912 00000100:00100000:1.0:1787579930.744651:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262758912 00000100:00100000:1.0:1787579930.744714:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787579930.744725:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7f5bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874413262758912:12345-0@lo:13: 00000100:00080000:0.0:1787579930.744836:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1787579930.745424:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787579930.745682:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7f5bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874413262758912:12345-0@lo:13: Request processed in 956us (1343us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579930.745693:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1787579930.745792:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae7f35ed80 x1874413262758912/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787579946 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787579930.745811:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7f35ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874413262758912:0@lo:13: 00010000:00010000:3.0:1787579931.124424:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787579931.260655:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7f35e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3317:1874413262759040:0@lo:400: 00000100:00100000:1.0:1787579931.260737:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579931.260785:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7f35e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1874413262759552:0@lo:400: 00000100:00100000:1.0:1787579931.260808:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579931.262087:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787579931.262102:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7f35ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874413262759424:0@lo:400: 00000100:00100000:1.0:1787579931.262148:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579931.262194:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7f35dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874413262759168:0@lo:400: 00000100:00100000:1.0:1787579931.262236:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579931.262256:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7f35c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874413262759680:0@lo:400: 00000100:00100000:1.0:1787579931.262277:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579931.262298:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787579931.262303:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7f35df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874413262759296:0@lo:400: 00000100:00100000:1.0:1787579931.262323:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579931.262357:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262759040 00000100:00100000:1.0:1787579931.262365:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262759040 00000100:00100000:1.0:1787579931.262574:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1787579931.262584:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:3317:x1874413262759040:12345-0@lo:400: 00000100:00100000:1.0:1787579931.262640:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:3317:x1874413262759040:12345-0@lo:400: Request processed in 57us (1903us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579931.262647:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1787579931.262681:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262759552 00000100:00100000:1.0:1787579931.262686:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262759552 00000100:00100000:1.0:1787579931.262717:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262759168 00000100:00100000:1.0:1787579931.262720:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262759168 00000100:00100000:1.0:1787579931.262731:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262759296 00000100:00100000:1.0:1787579931.262733:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262759296 00000100:00100000:1.0:1787579931.262746:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787579931.262753:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7f35ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1874413262759552:12345-0@lo:400: 00000100:00100000:1.0:1787579931.262786:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7f35ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1874413262759552:12345-0@lo:400: Request processed in 33us (1976us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579931.262792:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787579931.262802:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787579931.262808:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7f35d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874413262759168:12345-0@lo:400: 00000100:00100000:3.0:1787579931.262943:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262759424 00000100:00100000:3.0:1787579931.262948:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262759424 00000100:00100000:3.0:1787579931.262978:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262759680 00000100:00100000:3.0:1787579931.262980:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262759680 00000100:00100000:3.0:1787579931.262996:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787579931.263003:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7f35c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1874413262759424:12345-0@lo:400: 00000100:00100000:3.0:1787579931.263036:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7f35c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1874413262759424:12345-0@lo:400: Request processed in 33us (888us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579931.263053:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787579931.263067:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787579931.263072:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7f35ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874413262759680:12345-0@lo:400: 00000100:00100000:1.0:1787579931.263123:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7f35d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874413262759168:12345-0@lo:400: Request processed in 314us (886us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579931.263138:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787579931.263150:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787579931.263156:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874413262759296:12345-0@lo:400: 00000100:00100000:3.0:1787579931.269302:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7f35ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874413262759680:12345-0@lo:400: Request processed in 6218us (7013us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579931.269319:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787579931.270050:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874413262759296:12345-0@lo:400: Request processed in 6891us (7723us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579931.270061:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:1.0:1787579931.270100:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787579931.270108:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787579931.270152:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7f35df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874413262759296:0@lo:400: 00000100:00100000:1.0:1787579931.270166:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7f35dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874413262759168:0@lo:400: 00010000:00080000:1.0:1787579931.270182:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae7f35c700 x1874413262759680/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787579947 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787579931.270191:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7f35c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874413262759680:0@lo:400: 00010000:00080000:1.0:1787579931.270241:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae7f35ea00 x1874413262759424/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787579947 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787579931.270251:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7f35ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874413262759424:0@lo:400: 00000100:00100000:1.0:1787579931.270262:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7f35e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3317:1874413262759040:0@lo:400: 00000100:00100000:1.0:1787579931.270273:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7f35e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1874413262759552:0@lo:400: 00000001:00100000:3.0:1787579931.303957:0:5874:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 31d1df27-21ab-4c76-bd19-e53fa778bd7e 00000100:00100000:2.0:1787579931.767920:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787579931.767953:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5f4aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874413262759808:0@lo:13: 00000100:00100000:2.0:1787579931.768043:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579931.769135:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262759808 00000100:00100000:3.0:1787579931.769147:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262759808 00000100:00100000:3.0:1787579931.769202:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787579931.769246:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae77aabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874413262759808:12345-0@lo:13: 00002000:00000024:3.0:1787579931.769284:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787579931.769359:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae77aabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874413262759808:12345-0@lo:13: Request processed in 115us (1330us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579931.769367:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1787579931.769961:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae5f4aca80 x1874413262759808/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787579947 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787579931.769983:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5f4aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874413262759808:0@lo:13: 00000001:00100000:2.0:1787579931.873407:0:7653:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 31d1df27-21ab-4c76-bd19-e53fa778bd7e 00000001:00100000:1.0:1787579931.896832:0:6733:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 31d1df27-21ab-4c76-bd19-e53fa778bd7e 00010000:00010000:1.0:1787579932.147562:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787579932.624887:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787579932.624933:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787579932.624972:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787579932.625019:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787579932.625057:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239668352 00000100:00100000:1.0:1787579932.625069:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239668352 00000100:00100000:1.0:1787579932.625138:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 27 00000100:00100000:1.0:1787579932.625150:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:2360:x1874413239668352:12345-192.168.202.36@tcp:400: 00000100:00100000:1.0:1787579932.625254:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:2360:x1874413239668352:12345-192.168.202.36@tcp:400: Request processed in 106us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579932.625262:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 27 00000100:00100000:1.0:1787579932.625290:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239668480 00000100:00100000:1.0:1787579932.625294:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239668480 00000100:00100000:1.0:1787579932.625319:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239668608 00000100:00100000:1.0:1787579932.625322:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239668608 00000100:00100000:1.0:1787579932.625340:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 9 00000100:00100000:1.0:1787579932.625345:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+5:2360:x1874413239668480:12345-192.168.202.36@tcp:400: 00000100:00100000:1.0:1787579932.625376:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+5:2360:x1874413239668480:12345-192.168.202.36@tcp:400: Request processed in 30us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579932.625409:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 9 00000100:00100000:1.0:1787579932.625422:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 10 00000100:00100000:1.0:1787579932.625429:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+5:2360:x1874413239668608:12345-192.168.202.36@tcp:400: 00000100:00100000:1.0:1787579932.625453:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+5:2360:x1874413239668608:12345-192.168.202.36@tcp:400: Request processed in 25us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579932.625459:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 10 00000100:00080000:1.0:1787579932.625476:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787579932.625480:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787579932.625482:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787579932.626091:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239668224 00000100:00100000:3.0:1787579932.626101:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239668224 00000100:00100000:3.0:1787579932.626133:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 132 00000100:00100000:3.0:1787579932.626142:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5ba0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ff68ada-0c43-4367-93b7-ad31684360cf+10:2360:x1874413239668224:12345-192.168.202.36@tcp:400: 00000100:00100000:3.0:1787579932.626236:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5ba0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ff68ada-0c43-4367-93b7-ad31684360cf+10:2360:x1874413239668224:12345-192.168.202.36@tcp:400: Request processed in 95us (1361us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579932.626244:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 132 00000001:02000400:0.0:1787579932.708031:0:8304:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1787579933.171801:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579934.198114:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579935.220120:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787579935.864958:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787579935.864988:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae77aa8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874413262759936:0@lo:13: 00000100:00100000:2.0:1787579935.865134:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579935.865220:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262759936 00000100:00100000:2.0:1787579935.865228:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262759936 00000100:00100000:2.0:1787579935.865285:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787579935.865294:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae77aab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874413262759936:12345-0@lo:13: 00002000:00000024:2.0:1787579935.865612:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787579935.865663:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae77aab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874413262759936:12345-0@lo:13: Request processed in 369us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579935.865669:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1787579935.865691:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787579935.865720:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae77aa8a80 x1874413262759936/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787579951 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787579935.865737:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae77aa8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874413262759936:0@lo:13: 00010000:00010000:3.0:1787579936.244593:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787579936.321154:0:8452:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffceb3eb820 20000000:00000080:2.0:1787579936.321189:0:8452:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8fae6d694400 uarg=0000000000000000 20000000:01000000:2.0:1787579936.321227:0:8452:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1787579936.321230:0:8452:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1787579936.321233:0:8452:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1787579936.321237:0:8452:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1787579936.321242:0:8452:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1787579936.321255:0:8452:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787579936.321258:0:8452:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1787579936.321718:0:8452:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787579936.321722:0:8452:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1787579936.323695:0:8453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:2.0:1787579936.324621:0:8452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:2.0:1787579936.324680:0:8452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:2.0:1787579936.324732:0:8452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:2.0:1787579936.324747:0:8452:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1787579936.324749:0:8452:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1787579936.325909:0:8454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:2.0:1787579936.326906:0:8452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:2.0:1787579936.326975:0:8452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:2.0:1787579936.327087:0:8452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:2.0:1787579936.327104:0:8452:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787579936.327107:0:8452:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1787579936.328081:0:8455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:2.0:1787579936.328754:0:8452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:2.0:1787579936.328880:0:8452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:2.0:1787579936.328918:0:8452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:2.0:1787579936.328932:0:8452:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1787579936.328935:0:8452:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1787579936.329952:0:8456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:2.0:1787579936.330906:0:8452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:2.0:1787579936.330977:0:8452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:2.0:1787579936.331084:0:8452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:2.0:1787579936.331103:0:8452:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787579936.331124:0:8452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8fae74ed8800/0xc86deac2083376ed lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579936.331155:0:8452:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fae4150fe00/0xc86deac2083375ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac2083375e3 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579936.331173:0:8452:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fae4150ee00/0xc86deac208337614 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac20833760d expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579936.331181:0:8452:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fae50feb200/0xc86deac20833763e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac208337637 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579936.331187:0:8452:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fae4ca58800/0xc86deac20833764c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac208337645 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579936.331194:0:8452:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fae50feaa00/0xc86deac20833765a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac208337653 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579936.331201:0:8452:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fae41660200/0xc86deac208337676 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac20833766f expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579936.331207:0:8452:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fae41660e00/0xc86deac2083376a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac208337692 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579936.331216:0:8452:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fae41660600/0xc86deac2083376ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9cf7f expref: 9 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579936.331223:0:8452:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fae4ca58c00/0xc86deac2083376b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9cf86 expref: 9 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579936.331230:0:8452:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8fae74ed8800/0xc86deac2083376ed lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579936.331284:0:8452:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fae4ca58c00/0xc86deac2083376b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9cf86 expref: 9 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579936.331299:0:8452:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8fae4ca58c00/0xc86deac2083376b5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9cf86 expref: 9 pid: 5845 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579936.331312:0:8452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae77aa8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1874413262760064:192.168.202.36@tcp:104: 00010000:00010000:2.0:1787579936.331642:0:8452:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fae41660600/0xc86deac2083376ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9cf7f expref: 9 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579936.331651:0:8452:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8fae41660600/0xc86deac2083376ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9cf7f expref: 9 pid: 5847 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579936.331660:0:8452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae77aab100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1874413262760192:192.168.202.36@tcp:104: 00010000:00010000:2.0:1787579936.331693:0:8452:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fae41660e00/0xc86deac2083376a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc86deac208337692 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579936.331700:0:8452:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fae41660e00/0xc86deac2083376a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc86deac208337692 expref: 18 pid: 5845 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579936.331709:0:8452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae77aa9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1874413262760320:0@lo:104: 00000100:00100000:2.0:1787579936.331746:0:8452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787579936.331882:0:8452:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fae41660200/0xc86deac208337676 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc86deac20833766f expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579936.331891:0:8452:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fae41660200/0xc86deac208337676 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc86deac20833766f expref: 18 pid: 5847 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579936.331912:0:8452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae77aaa680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1874413262760448:0@lo:104: 00000100:00100000:2.0:1787579936.331937:0:8452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787579936.333916:0:8452:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fae50feaa00/0xc86deac20833765a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc86deac208337653 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579936.333950:0:8452:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fae50feaa00/0xc86deac20833765a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc86deac208337653 expref: 18 pid: 5845 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579936.333963:0:8452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae48c92a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1874413262760576:0@lo:104: 00010000:00010000:1.0:1787579936.334019:0:8452:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fae4ca58800/0xc86deac20833764c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc86deac208337645 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579936.334028:0:8452:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fae4ca58800/0xc86deac20833764c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc86deac208337645 expref: 18 pid: 5848 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579936.334037:0:8452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7f35e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1874413262760704:0@lo:104: 00010000:00010000:1.0:1787579936.334063:0:8452:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fae50feb200/0xc86deac20833763e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc86deac208337637 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579936.334071:0:8452:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fae50feb200/0xc86deac20833763e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc86deac208337637 expref: 18 pid: 5847 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579936.334079:0:8452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7f35e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1874413262760832:0@lo:104: 00010000:00010000:1.0:1787579936.334110:0:8452:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fae4150ee00/0xc86deac208337614 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc86deac20833760d expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579936.334118:0:8452:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fae4150ee00/0xc86deac208337614 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc86deac20833760d expref: 18 pid: 5848 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579936.334125:0:8452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7f35ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1874413262760960:0@lo:104: 00010000:00010000:1.0:1787579936.334149:0:8452:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fae4150fe00/0xc86deac2083375ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc86deac2083375e3 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579936.334183:0:8452:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fae4150fe00/0xc86deac2083375ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc86deac2083375e3 expref: 18 pid: 5848 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579936.334191:0:8452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7f35c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1874413262761088:0@lo:104: 00000100:00100000:1.0:1787579936.334212:0:8452:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae80201000 going to sleep for 11 seconds 00000100:00100000:1.0:1787579936.334241:0:8452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae77aa8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1874413262760064:192.168.202.36@tcp:104: 00000100:00100000:1.0:1787579936.334251:0:8452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae77aab100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1874413262760192:192.168.202.36@tcp:104: 00000100:00100000:1.0:1787579936.335364:0:5837:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787579936.335434:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579936.335454:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579936.335483:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579936.335495:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579936.335516:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579936.335528:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262760320 00000100:00100000:1.0:1787579936.335537:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262760320 00000100:00100000:1.0:1787579936.335583:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262760448 00000100:00100000:1.0:1787579936.335586:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262760448 00000100:00100000:1.0:1787579936.335597:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262760576 00000100:00100000:1.0:1787579936.335599:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262760576 00000100:00100000:1.0:1787579936.335607:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262760704 00000100:00100000:1.0:1787579936.335609:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262760704 00000100:00100000:1.0:1787579936.335617:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262760832 00000100:00100000:1.0:1787579936.335619:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262760832 00000100:00100000:1.0:1787579936.335629:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262760960 00000100:00100000:1.0:1787579936.335631:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262760960 00000100:00100000:1.0:1787579936.335642:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262761088 00000100:00100000:1.0:1787579936.335644:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262761088 00000100:00100000:1.0:1787579936.335657:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787579936.335666:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae77aaad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+9:8452:x1874413262760320:12345-0@lo:104: 00010000:00010000:1.0:1787579936.335692:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.136@tcp lock: ffff8fae50feb000/0xc86deac208337692 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc86deac2083376a0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579936.335895:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787579936.335901:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae77aaad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+9:8452:x1874413262760320:12345-0@lo:104: Request processed in 237us (4155us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579936.335908:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787579936.335932:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787579936.335939:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7ec68450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+8:8452:x1874413262760448:12345-0@lo:104: 00010000:00010000:1.0:1787579936.335947:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.136@tcp lock: ffff8fae41660a00/0xc86deac20833766f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc86deac208337676 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579936.335981:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787579936.336047:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7ec68450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+8:8452:x1874413262760448:12345-0@lo:104: Request processed in 50us (4050us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579936.336055:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787579936.336158:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787579936.336173:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7f35dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+7:8452:x1874413262760576:12345-0@lo:104: 00010000:00010000:1.0:1787579936.336181:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.136@tcp lock: ffff8fae4150fa00/0xc86deac208337653 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc86deac20833765a expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579936.336216:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787579936.336221:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7f35dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+7:8452:x1874413262760576:12345-0@lo:104: Request processed in 58us (789us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579936.336227:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787579936.336238:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787579936.336244:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7f35df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+6:8452:x1874413262760704:12345-0@lo:104: 00010000:00010000:1.0:1787579936.336257:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.136@tcp lock: ffff8fae4150f600/0xc86deac208337645 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc86deac20833764c expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579936.336288:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1787579936.336293:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7f35df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+6:8452:x1874413262760704:12345-0@lo:104: Request processed in 50us (838us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579936.336299:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787579936.336311:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787579936.336317:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5f811500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+5:8452:x1874413262760832:12345-0@lo:104: 00010000:00010000:1.0:1787579936.336324:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.136@tcp lock: ffff8fae4150fc00/0xc86deac208337637 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc86deac20833763e expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579936.336349:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1787579936.336354:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5f811500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+5:8452:x1874413262760832:12345-0@lo:104: Request processed in 38us (872us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579936.336359:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787579936.336369:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787579936.336375:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5f813b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+4:8452:x1874413262760960:12345-0@lo:104: 00010000:00010000:1.0:1787579936.336401:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.136@tcp lock: ffff8fae50feb400/0xc86deac20833760d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc86deac208337614 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579936.336427:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:1.0:1787579936.336433:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5f813b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+4:8452:x1874413262760960:12345-0@lo:104: Request processed in 58us (937us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579936.336439:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787579936.336451:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787579936.336457:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5f810a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+3:8452:x1874413262761088:12345-0@lo:104: 00010000:00010000:1.0:1787579936.336470:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.136@tcp lock: ffff8fae41661200/0xc86deac2083375e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc86deac2083375ea expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579936.336634:0:8452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae77aa9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1874413262760320:0@lo:104: 00000100:00100000:0.0:1787579936.336644:0:8452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae77aaa680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1874413262760448:0@lo:104: 00000100:00100000:0.0:1787579936.336653:0:8452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae48c92a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1874413262760576:0@lo:104: 00000100:00100000:0.0:1787579936.336660:0:8452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7f35e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1874413262760704:0@lo:104: 00000100:00100000:0.0:1787579936.336666:0:8452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7f35e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1874413262760832:0@lo:104: 00000100:00100000:0.0:1787579936.336673:0:8452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7f35ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1874413262760960:0@lo:104: 00000100:00100000:0.0:1787579936.336679:0:8452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7f35c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1874413262761088:0@lo:104: 00010000:00010000:0.0:1787579936.336726:0:8452:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8fae74ed8800/0xc86deac2083376ed lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579936.336837:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:1.0:1787579936.336844:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5f810a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+3:8452:x1874413262761088:12345-0@lo:104: Request processed in 387us (1326us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579936.336851:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787579936.336967:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787579936.337074:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787579936.337233:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239668736 00000100:00100000:1.0:1787579936.337241:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239668736 00010000:00010000:1.0:1787579936.337265:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fae4ca58c00/0xc86deac2083376b5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9cf86 expref: 10 pid: 5845 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579936.337456:0:5836:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00010000:00010000:3.0:1787579936.337473:0:7643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1787579936.337479:0:7643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.136@tcp lock: ffff8fae50feb000/0xc86deac208337692 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc86deac2083376a0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579936.337487:0:7643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae50feb000 already unused, calling callback (ffffffffc1b77c20) 10000000:00010000:3.0:1787579936.337491:0:7643:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.136@tcp lock: ffff8fae50feb000/0xc86deac208337692 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xc86deac2083376a0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579936.337511:0:7643:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: ffff8fae50feb000/0xc86deac208337692 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xc86deac2083376a0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787579936.337519:0:7643:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: ffff8fae50feb000/0xc86deac208337692 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xc86deac2083376a0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787579936.337525:0:7643:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787579936.337562:0:7643:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.136@tcp lock: ffff8fae50feb000/0xc86deac208337692 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac2083376a0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579936.337569:0:7643:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787579936.337592:0:7643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.136@tcp lock: ffff8fae50feb000/0xc86deac208337692 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac2083376a0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579936.337600:0:7643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: ffff8fae50feb000/0xc86deac208337692 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac2083376a0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579936.337614:0:7643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1787579936.337618:0:7643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.136@tcp lock: ffff8fae41660a00/0xc86deac20833766f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xc86deac208337676 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579936.337623:0:7643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae41660a00 already unused, calling callback (ffffffffc1b77c20) 10000000:00010000:3.0:1787579936.337635:0:7643:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.136@tcp lock: ffff8fae41660a00/0xc86deac20833766f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xc86deac208337676 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579936.337641:0:7643:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: ffff8fae41660a00/0xc86deac20833766f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xc86deac208337676 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787579936.337647:0:7643:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: ffff8fae41660a00/0xc86deac20833766f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xc86deac208337676 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787579936.337652:0:7643:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787579936.337666:0:7643:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.136@tcp lock: ffff8fae41660a00/0xc86deac20833766f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac208337676 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579936.337672:0:7643:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787579936.337687:0:7643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.136@tcp lock: ffff8fae41660a00/0xc86deac20833766f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac208337676 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579936.337694:0:7643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: ffff8fae41660a00/0xc86deac20833766f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac208337676 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579936.337703:0:7643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1787579936.337706:0:7643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.136@tcp lock: ffff8fae4150fa00/0xc86deac208337653 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc86deac20833765a expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579936.337712:0:7643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae4150fa00 already unused, calling callback (ffffffffc1b77c20) 10000000:00010000:3.0:1787579936.337714:0:7643:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.136@tcp lock: ffff8fae4150fa00/0xc86deac208337653 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xc86deac20833765a expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579936.337721:0:7643:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: ffff8fae4150fa00/0xc86deac208337653 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xc86deac20833765a expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787579936.337739:0:7643:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: ffff8fae4150fa00/0xc86deac208337653 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xc86deac20833765a expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787579936.337745:0:7643:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787579936.337770:0:7643:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.136@tcp lock: ffff8fae4150fa00/0xc86deac208337653 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac20833765a expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579936.337776:0:7643:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787579936.337782:0:7643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.136@tcp lock: ffff8fae4150fa00/0xc86deac208337653 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac20833765a expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579936.337787:0:7643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: ffff8fae4150fa00/0xc86deac208337653 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac20833765a expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579936.337797:0:7643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787579936.337800:0:7643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.136@tcp lock: ffff8fae4150f600/0xc86deac208337645 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc86deac20833764c expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579936.337805:0:7643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae4150f600 already unused, calling callback (ffffffffc1b77c20) 10000000:00010000:3.0:1787579936.337807:0:7643:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.136@tcp lock: ffff8fae4150f600/0xc86deac208337645 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc86deac20833764c expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579936.337813:0:7643:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: ffff8fae4150f600/0xc86deac208337645 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc86deac20833764c expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787579936.337818:0:7643:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: ffff8fae4150f600/0xc86deac208337645 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc86deac20833764c expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787579936.337823:0:7643:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787579936.337841:0:7643:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.136@tcp lock: ffff8fae4150f600/0xc86deac208337645 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac20833764c expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579936.337847:0:7643:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787579936.337852:0:7643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.136@tcp lock: ffff8fae4150f600/0xc86deac208337645 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac20833764c expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579936.337857:0:7643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: ffff8fae4150f600/0xc86deac208337645 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac20833764c expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579936.337866:0:7643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787579936.337869:0:7643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.136@tcp lock: ffff8fae4150fc00/0xc86deac208337637 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc86deac20833763e expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579936.337874:0:7643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae4150fc00 already unused, calling callback (ffffffffc1b77c20) 10000000:00010000:3.0:1787579936.337877:0:7643:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.136@tcp lock: ffff8fae4150fc00/0xc86deac208337637 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc86deac20833763e expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579936.337883:0:7643:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: ffff8fae4150fc00/0xc86deac208337637 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc86deac20833763e expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787579936.337888:0:7643:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: ffff8fae4150fc00/0xc86deac208337637 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc86deac20833763e expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787579936.337892:0:7643:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787579936.337919:0:7643:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.136@tcp lock: ffff8fae4150fc00/0xc86deac208337637 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac20833763e expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579936.337925:0:7643:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787579936.337930:0:7643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.136@tcp lock: ffff8fae4150fc00/0xc86deac208337637 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac20833763e expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579936.337944:0:7643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: ffff8fae4150fc00/0xc86deac208337637 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac20833763e expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579936.337953:0:7643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787579936.337956:0:7643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.136@tcp lock: ffff8fae50feb400/0xc86deac20833760d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc86deac208337614 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579936.337961:0:7643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae50feb400 already unused, calling callback (ffffffffc1b77c20) 10000000:00010000:3.0:1787579936.337964:0:7643:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.136@tcp lock: ffff8fae50feb400/0xc86deac20833760d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc86deac208337614 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579936.337971:0:7643:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: ffff8fae50feb400/0xc86deac20833760d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc86deac208337614 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787579936.337978:0:7643:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: ffff8fae50feb400/0xc86deac20833760d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc86deac208337614 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787579936.337983:0:7643:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787579936.338007:0:7643:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.136@tcp lock: ffff8fae50feb400/0xc86deac20833760d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac208337614 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579936.338013:0:7643:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787579936.338017:0:7643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.136@tcp lock: ffff8fae50feb400/0xc86deac20833760d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac208337614 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579936.338024:0:7643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: ffff8fae50feb400/0xc86deac20833760d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac208337614 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579936.338032:0:7643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787579936.338041:0:7643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.136@tcp lock: ffff8fae41661200/0xc86deac2083375e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc86deac2083375ea expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579936.338047:0:7643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae41661200 already unused, calling callback (ffffffffc1b77c20) 10000000:00010000:3.0:1787579936.338050:0:7643:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.136@tcp lock: ffff8fae41661200/0xc86deac2083375e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc86deac2083375ea expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579936.338056:0:7643:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: ffff8fae41661200/0xc86deac2083375e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc86deac2083375ea expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787579936.338062:0:7643:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: ffff8fae41661200/0xc86deac2083375e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc86deac2083375ea expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787579936.338067:0:7643:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787579936.338080:0:7643:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.136@tcp lock: ffff8fae41661200/0xc86deac2083375e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac2083375ea expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579936.338097:0:7643:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787579936.338102:0:7643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.136@tcp lock: ffff8fae41661200/0xc86deac2083375e3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac2083375ea expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579936.338109:0:7643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: ffff8fae41661200/0xc86deac2083375e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac2083375ea expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579936.338124:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579936.338126:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579936.338128:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579936.338137:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579936.338142:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579936.338146:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787579936.338176:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5f4ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3317:1874413262761216:0@lo:103: 00000100:00100000:3.0:1787579936.338225:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579936.338992:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d663100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3317:1874413262761728:0@lo:103: 00000100:00100000:3.0:1787579936.339029:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579936.339093:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239668864 00000100:00100000:1.0:1787579936.339101:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239668864 00010000:00010000:1.0:1787579936.339132:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fae41660600/0xc86deac2083376ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9cf7f expref: 11 pid: 5847 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579936.339149:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262761216 00000100:00100000:1.0:1787579936.339153:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262761216 00010000:00010000:1.0:1787579936.339174:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fae41660e00/0xc86deac2083376a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc86deac208337692 expref: 19 pid: 5845 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579936.339190:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 12 00000100:00100000:1.0:1787579936.339199:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae77aa9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ff68ada-0c43-4367-93b7-ad31684360cf+11:2360:x1874413239668736:12345-192.168.202.36@tcp:103: 00010000:00010000:1.0:1787579936.339214:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787579936.339221:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fae4ca58c00/0xc86deac2083376b5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9cf86 expref: 11 pid: 5845 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579936.339232:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fae4ca58c00/0xc86deac2083376b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9cf86 expref: 11 pid: 5845 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579936.339257:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fae4ca58c00/0xc86deac2083376b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9cf86 expref: 11 pid: 5845 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579936.339271:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787579936.339315:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae77aa9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ff68ada-0c43-4367-93b7-ad31684360cf+10:2360:x1874413239668736:12345-192.168.202.36@tcp:103: Request processed in 117us (2350us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579936.339322:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 12 00000100:00100000:1.0:1787579936.339340:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 13 00000100:00100000:1.0:1787579936.339346:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae77aa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ff68ada-0c43-4367-93b7-ad31684360cf+9:2360:x1874413239668864:12345-192.168.202.36@tcp:103: 00010000:00010000:1.0:1787579936.339354:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787579936.339359:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fae41660600/0xc86deac2083376ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9cf7f expref: 9 pid: 5847 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579936.339368:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fae41660600/0xc86deac2083376ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9cf7f expref: 9 pid: 5847 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579936.339378:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fae41660600/0xc86deac2083376ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9cf7f expref: 9 pid: 5847 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579936.339408:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787579936.339428:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae77aa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ff68ada-0c43-4367-93b7-ad31684360cf+8:2360:x1874413239668864:12345-192.168.202.36@tcp:103: Request processed in 82us (2354us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579936.339433:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 13 00000100:00100000:1.0:1787579936.339446:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787579936.339452:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d662680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:3317:x1874413262761216:12345-0@lo:103: 00010000:00010000:1.0:1787579936.339460:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787579936.339470:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fae41660e00/0xc86deac2083376a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc86deac208337692 expref: 19 pid: 5845 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579936.339478:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fae41660e00/0xc86deac2083376a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc86deac208337692 expref: 19 pid: 5845 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579936.339489:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fae41660e00/0xc86deac2083376a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc86deac208337692 expref: 19 pid: 5845 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579936.339659:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787579936.339692:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d662680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+18:3317:x1874413262761216:12345-0@lo:103: Request processed in 239us (1465us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579936.339699:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787579936.340470:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5f4af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3316:1874413262761600:0@lo:103: 00000100:00100000:2.0:1787579936.340878:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5f4aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3314:1874413262761344:0@lo:103: 00000100:00100000:2.0:1787579936.341210:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579936.341232:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d661180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3314:1874413262761856:0@lo:103: 00000100:00100000:2.0:1787579936.341256:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579936.341273:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787579936.341279:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5f4ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3314:1874413262761472:0@lo:103: 00000100:00100000:2.0:1787579936.341301:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579936.341311:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d662d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3314:1874413262761984:0@lo:103: 00000100:00100000:2.0:1787579936.341326:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579936.341346:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262761728 00000100:00100000:2.0:1787579936.341352:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262761728 00010000:00010000:2.0:1787579936.341402:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fae50feb200/0xc86deac20833763e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc86deac208337637 expref: 18 pid: 5847 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579936.341423:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262761344 00000100:00100000:2.0:1787579936.341426:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262761344 00010000:00010000:2.0:1787579936.341436:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fae41660200/0xc86deac208337676 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc86deac20833766f expref: 19 pid: 5847 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579936.341445:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262761856 00000100:00100000:2.0:1787579936.341447:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262761856 00010000:00010000:2.0:1787579936.341455:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fae4150ee00/0xc86deac208337614 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc86deac20833760d expref: 20 pid: 5848 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579936.341486:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262761472 00000100:00100000:2.0:1787579936.341490:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262761472 00010000:00010000:2.0:1787579936.341510:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fae50feaa00/0xc86deac20833765a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc86deac208337653 expref: 21 pid: 5845 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579936.341521:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262761984 00000100:00100000:2.0:1787579936.341523:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262761984 00010000:00010000:2.0:1787579936.341533:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fae4150fe00/0xc86deac2083375ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc86deac2083375e3 expref: 22 pid: 5848 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579936.341545:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787579936.341553:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d661c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+22:3317:x1874413262761728:12345-0@lo:103: 00010000:00010000:2.0:1787579936.341566:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787579936.341571:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fae50feb200/0xc86deac20833763e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc86deac208337637 expref: 22 pid: 5847 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579936.341581:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fae50feb200/0xc86deac20833763e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc86deac208337637 expref: 22 pid: 5847 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579936.341598:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fae50feb200/0xc86deac20833763e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc86deac208337637 expref: 22 pid: 5847 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579936.341611:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787579936.341640:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d661c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+21:3317:x1874413262761728:12345-0@lo:103: Request processed in 87us (2610us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579936.341646:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787579936.341662:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787579936.341668:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae77aaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+20:3314:x1874413262761344:12345-0@lo:103: 00010000:00010000:2.0:1787579936.341683:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787579936.341687:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fae41660200/0xc86deac208337676 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc86deac20833766f expref: 20 pid: 5847 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579936.341697:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fae41660200/0xc86deac208337676 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc86deac20833766f expref: 20 pid: 5847 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579936.341707:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fae41660200/0xc86deac208337676 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc86deac20833766f expref: 20 pid: 5847 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579936.341717:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787579936.341742:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae77aaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:3314:x1874413262761344:12345-0@lo:103: Request processed in 74us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579936.341749:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787579936.341897:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787579936.341905:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae77aaa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+18:3314:x1874413262761856:12345-0@lo:103: 00010000:00010000:2.0:1787579936.341913:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787579936.341917:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fae4150ee00/0xc86deac208337614 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc86deac20833760d expref: 18 pid: 5848 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579936.341925:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fae4150ee00/0xc86deac208337614 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc86deac20833760d expref: 18 pid: 5848 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579936.341934:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fae4150ee00/0xc86deac208337614 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc86deac20833760d expref: 18 pid: 5848 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579936.341943:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787579936.341966:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae77aaa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+17:3314:x1874413262761856:12345-0@lo:103: Request processed in 64us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579936.341971:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787579936.342001:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787579936.342008:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae77aaa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+16:3314:x1874413262761472:12345-0@lo:103: 00010000:00010000:2.0:1787579936.342015:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787579936.342020:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fae50feaa00/0xc86deac20833765a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc86deac208337653 expref: 16 pid: 5845 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579936.342028:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fae50feaa00/0xc86deac20833765a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc86deac208337653 expref: 16 pid: 5845 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579936.342039:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fae50feaa00/0xc86deac20833765a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc86deac208337653 expref: 16 pid: 5845 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579936.342046:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787579936.342068:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae77aaa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+15:3314:x1874413262761472:12345-0@lo:103: Request processed in 61us (766us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579936.342073:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787579936.342210:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787579936.342218:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae77aa9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+14:3314:x1874413262761984:12345-0@lo:103: 00010000:00010000:2.0:1787579936.342226:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787579936.342230:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fae4150fe00/0xc86deac2083375ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc86deac2083375e3 expref: 14 pid: 5848 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579936.342239:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fae4150fe00/0xc86deac2083375ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc86deac2083375e3 expref: 14 pid: 5848 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579936.342249:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fae4150fe00/0xc86deac2083375ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc86deac2083375e3 expref: 14 pid: 5848 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579936.342258:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787579936.342279:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae77aa9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+13:3314:x1874413262761984:12345-0@lo:103: Request processed in 62us (951us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579936.342290:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787579936.342507:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5f4ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3314:1874413262761472:0@lo:103: 00000100:00100000:2.0:1787579936.342518:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d662d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3314:1874413262761984:0@lo:103: 00000100:00100000:2.0:1787579936.342526:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5f4aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3314:1874413262761344:0@lo:103: 00000100:00100000:2.0:1787579936.342533:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d661180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3314:1874413262761856:0@lo:103: 00000100:00100000:3.0:1787579936.342719:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5f4ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3317:1874413262761216:0@lo:103: 00000100:00100000:3.0:1787579936.342728:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d663100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3317:1874413262761728:0@lo:103: 00000100:00100000:3.0:1787579936.342752:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579936.342890:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262761600 00000100:00100000:2.0:1787579936.342896:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262761600 00010000:00010000:2.0:1787579936.342916:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fae4ca58800/0xc86deac20833764c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc86deac208337645 expref: 13 pid: 5848 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579936.342975:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787579936.342982:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae52135850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+13:3316:x1874413262761600:12345-0@lo:103: 00010000:00010000:2.0:1787579936.343000:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787579936.343005:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fae4ca58800/0xc86deac20833764c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc86deac208337645 expref: 13 pid: 5848 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579936.343014:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fae4ca58800/0xc86deac20833764c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc86deac208337645 expref: 13 pid: 5848 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579936.343024:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fae4ca58800/0xc86deac20833764c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc86deac208337645 expref: 13 pid: 5848 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579936.343039:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8fae74ed8800/0xc86deac2083376ed lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579936.343048:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fae74ed8800/0xc86deac2083376ed lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579936.343075:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fae74ed8800/0xc86deac2083376ed lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579936.343200:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fae74ed8800/0xc86deac2083376ed lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579936.343209:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8fae74ed8800/0xc86deac2083376ed lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579936.343216:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8fae74ed8800/0xc86deac2083376ed lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579936.343221:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae74ed8800 already unused, calling callback (ffffffffc155a230) 00010000:00010000:2.0:1787579936.343225:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8fae74ed8800/0xc86deac2083376ed lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579936.343232:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8fae74ed8800/0xc86deac2083376ed lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579936.343255:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8fae74ed8800/0xc86deac2083376ed lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579936.343266:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787579936.343299:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae52135850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+12:3316:x1874413262761600:12345-0@lo:103: Request processed in 318us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579936.343305:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787579936.343407:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5f4af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3316:1874413262761600:0@lo:103: 00010000:00010000:3.0:1787579936.343437:0:8452:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8fae74ed8800/0xc86deac2083376ed lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579936.343445:0:8452:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8fae74ed8800/0xc86deac2083376ed lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579936.343451:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fae74ed8800/0xc86deac2083376ed lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579936.376715:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae77aaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874413262762368:0@lo:400: 00000100:00100000:2.0:1787579936.376805:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579936.376843:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787579936.376849:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae77aaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874413262762496:0@lo:400: 00000100:00100000:2.0:1787579936.376885:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579936.377520:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262762368 00000100:00100000:1.0:1787579936.377528:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262762368 00000100:00100000:1.0:1787579936.377575:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787579936.377585:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae77aa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874413262762368:12345-0@lo:400: 00000100:00100000:1.0:1787579936.377646:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae77aa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874413262762368:12345-0@lo:400: Request processed in 62us (841us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579936.377653:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787579936.377676:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262762496 00000100:00100000:1.0:1787579936.377680:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262762496 00000100:00100000:1.0:1787579936.377712:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787579936.377718:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae77aaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874413262762496:12345-0@lo:400: 00000100:00100000:1.0:1787579936.377948:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae77aaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874413262762496:12345-0@lo:400: Request processed in 230us (1062us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579936.377955:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1787579936.378223:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787579936.378275:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae77aaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874413262762496:0@lo:400: 00010000:00080000:1.0:1787579936.378292:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae77aaaa00 x1874413262762368/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787579952 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787579936.381862:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae77aaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874413262762368:0@lo:400: 00000100:00100000:3.0:1787579936.382834:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae77aa9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874413262762112:0@lo:400: 00000100:00100000:3.0:1787579936.382921:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579936.382963:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae77aab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262762624:0@lo:400: 00000100:00100000:3.0:1787579936.383203:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579936.383234:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787579936.383241:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae77aa9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874413262762240:0@lo:400: 00000100:00100000:3.0:1787579936.383268:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579936.383302:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262762112 00000100:00100000:3.0:1787579936.383309:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262762112 00000100:00100000:3.0:1787579936.383355:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262762240 00000100:00100000:3.0:1787579936.383358:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262762240 00000100:00100000:3.0:1787579936.383429:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787579936.383438:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d663100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874413262762112:12345-0@lo:400: 00000100:00100000:3.0:1787579936.383498:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d663100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874413262762112:12345-0@lo:400: Request processed in 60us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579936.383505:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787579936.383522:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787579936.383528:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d662a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874413262762240:12345-0@lo:400: 00000100:00100000:3.0:1787579936.383554:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d662a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874413262762240:12345-0@lo:400: Request processed in 26us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579936.383559:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787579936.383578:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262762624 00000100:00100000:3.0:1787579936.383581:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262762624 00000100:00100000:3.0:1787579936.383607:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787579936.383614:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d661f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262762624:12345-0@lo:400: 00000100:00100000:3.0:1787579936.383645:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d661f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262762624:12345-0@lo:400: Request processed in 31us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579936.383650:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1787579936.383675:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787579936.383680:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787579936.383713:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae77aa9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874413262762240:0@lo:400: 00000100:00100000:3.0:1787579936.383722:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae77aa9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874413262762112:0@lo:400: 00010000:00080000:3.0:1787579936.383734:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae77aab100 x1874413262762624/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787579952 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787579936.383742:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae77aab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262762624:0@lo:400: 00000100:00100000:3.0:1787579936.883903:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787579936.883929:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d662300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262762752:0@lo:13: 00000100:00100000:3.0:1787579936.884012:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579936.884277:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262762752 00000100:00100000:2.0:1787579936.884285:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262762752 00000100:00100000:2.0:1787579936.884340:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787579936.884351:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d660700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262762752:12345-0@lo:13: 00002000:00000024:2.0:1787579936.884406:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787579936.884456:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d660700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262762752:12345-0@lo:13: Request processed in 107us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579936.884463:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1787579936.884503:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae6d662300 x1874413262762752/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787579952 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787579936.884520:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d662300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262762752:0@lo:13: 00010000:00010000:3.0:1787579937.271216:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787579937.717826:0:5850:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787579937.717836:0:5850:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8fae77937800 from 39 10000000:01000000:3.0:1787579937.717842:0:5850:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787579937.717894:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae4150fc00/0xc86deac2083376f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579937.717906:0:5850:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff8fae4150fc00/0xc86deac2083376f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579937.717918:0:5850:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff8fae4150fc00/0xc86deac2083376f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579937.717941:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d660e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262762880:0@lo:101: 00000100:00100000:3.0:1787579937.718018:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579937.718103:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae50fc2d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787579937.718418:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262762880 00000100:00100000:1.0:1787579937.718427:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262762880 00000100:00100000:1.0:1787579937.718484:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787579937.718494:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5ba0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+12:5850:x1874413262762880:12345-0@lo:101: 00010000:00010000:1.0:1787579937.718507:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787579937.718520:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fae4ca58c00/0xc86deac2083376fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc86deac2083376f4 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579937.718544:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fae4ca58c00/0xc86deac2083376fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc86deac2083376f4 expref: 13 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579937.718556:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fae4ca58c00/0xc86deac2083376fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac2083376f4 expref: 13 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579937.718565:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae4ca58c00, rc 0) 00000100:00100000:1.0:1787579937.718617:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5ba0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+13:5850:x1874413262762880:12345-0@lo:101: Request processed in 124us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579937.718623:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787579937.718729:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d660e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262762880:0@lo:101: 00010000:00010000:2.0:1787579937.718744:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff8fae4150fc00/0xc86deac2083376f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac2083376fb expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579937.718754:0:5850:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff8fae4150fc00/0xc86deac2083376f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc86deac2083376fb expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579937.718807:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae77aab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262763008:0@lo:501: 00000100:00100000:2.0:1787579937.718834:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579937.718863:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae7eec2300 going to sleep for 11 seconds 00000100:00100000:1.0:1787579937.718958:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262763008 00000100:00100000:1.0:1787579937.718962:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262763008 00000100:00100000:1.0:1787579937.718990:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1787579937.718998:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5ba09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+13:5850:x1874413262763008:12345-0@lo:501: 00000100:00100000:1.0:1787579937.719373:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5ba09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+13:5850:x1874413262763008:12345-0@lo:501: Request processed in 374us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579937.719421:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787579937.719486:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae77aab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262763008:0@lo:501: 00000100:00100000:2.0:1787579937.719511:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae77aab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262763136:0@lo:503: 00000100:00100000:2.0:1787579937.719545:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579937.719574:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae7eec2300 going to sleep for 11 seconds 00000100:00100000:1.0:1787579937.719740:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262763136 00000100:00100000:1.0:1787579937.719744:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262763136 00000100:00100000:1.0:1787579937.719782:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787579937.719790:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5ba09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+13:5850:x1874413262763136:12345-0@lo:503: 00000100:00100000:1.0:1787579937.720190:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5ba09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+13:5850:x1874413262763136:12345-0@lo:503: Request processed in 400us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579937.720198:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1787579937.724348:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae77aab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262763136:0@lo:503: 00000100:00100000:2.0:1787579937.725815:0:8471:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae77aa9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:8471:1874413262763264:0@lo:502: 00000100:00100000:2.0:1787579937.725999:0:8471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579937.726109:0:8471:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae7eec2e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787579937.726243:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262763264 00000100:00100000:1.0:1787579937.726251:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262763264 00000100:00100000:1.0:1787579937.726299:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787579937.726309:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5ba0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+13:8471:x1874413262763264:12345-0@lo:502: 00000100:00100000:1.0:1787579937.726972:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5ba0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+13:8471:x1874413262763264:12345-0@lo:502: Request processed in 661us (970us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579937.726981:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787579937.728139:0:8471:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae77aa9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:8471:1874413262763264:0@lo:502: 00000100:00100000:2.0:1787579937.728266:0:8471:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae77aa9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:8471:1874413262763392:0@lo:502: 00000100:00100000:2.0:1787579937.728320:0:8471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579937.729623:0:8471:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae7eec2e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787579937.729683:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262763392 00000100:00100000:3.0:1787579937.729691:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262763392 00000100:00100000:3.0:1787579937.729779:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1787579937.729790:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5ba0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+13:8471:x1874413262763392:12345-0@lo:502: 00000100:00100000:3.0:1787579937.731350:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5ba0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+13:8471:x1874413262763392:12345-0@lo:502: Request processed in 1558us (3025us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579937.731362:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1787579937.731496:0:8471:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae77aa9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:8471:1874413262763392:0@lo:502: 00000040:00080000:0.0:1787579937.731531:0:8471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1787579937.733246:0:5850:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1787579937.733281:0:5850:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787579937.733294:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae4150fc00/0xc86deac2083376f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac2083376fb expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579937.733308:0:5850:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff8fae4150fc00/0xc86deac2083376f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac2083376fb expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787579937.733319:0:5850:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1787579937.733322:0:5850:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1787579937.733325:0:5850:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1787579937.733372:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae4ca59400/0xc86deac208337702 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579937.733440:0:5850:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff8fae4ca59400/0xc86deac208337702 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579937.733453:0:5850:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff8fae4ca59400/0xc86deac208337702 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579937.733475:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5f813800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262763520:0@lo:101: 00000100:00100000:1.0:1787579937.733531:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579937.734207:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae4722d840 going to sleep for 11 seconds 00000100:00100000:2.0:1787579937.734239:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262763520 00000100:00100000:2.0:1787579937.734246:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262763520 00000100:00100000:2.0:1787579937.734300:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787579937.734321:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5ba08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+13:5850:x1874413262763520:12345-0@lo:101: 00010000:00010000:2.0:1787579937.734335:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787579937.734347:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fae74ed8c00/0xc86deac208337709 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc86deac208337702 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579937.734367:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fae74ed8c00/0xc86deac208337709 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc86deac208337702 expref: 14 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579937.734375:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fae74ed8c00/0xc86deac208337709 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac208337702 expref: 14 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579937.734399:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae74ed8c00, rc 0) 00000100:00100000:2.0:1787579937.734447:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5ba08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+14:5850:x1874413262763520:12345-0@lo:101: Request processed in 128us (914us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579937.734454:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787579937.734632:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5f813800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262763520:0@lo:101: 00010000:00010000:1.0:1787579937.734642:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff8fae4ca59400/0xc86deac208337702 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208337709 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579937.734649:0:5850:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff8fae4ca59400/0xc86deac208337702 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc86deac208337709 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579937.734686:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5f813800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262763648:0@lo:501: 00000100:00100000:1.0:1787579937.734704:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579937.734723:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae4722d840 going to sleep for 11 seconds 00000100:00100000:0.0:1787579937.734755:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262763648 00000100:00100000:0.0:1787579937.734758:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262763648 00000100:00100000:0.0:1787579937.734781:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1787579937.734788:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5ba08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+14:5850:x1874413262763648:12345-0@lo:501: 00000100:00100000:3.0:1787579937.735927:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787579937.735971:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787579937.736000:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787579937.736020:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787579937.736041:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239669376 00000100:00100000:3.0:1787579937.736059:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239669376 00000100:00100000:3.0:1787579937.736100:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239669248 00000100:00100000:3.0:1787579937.736103:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239669248 00000100:00100000:3.0:1787579937.736120:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 13 00000100:00100000:3.0:1787579937.736129:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d661880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+5:2361:x1874413239669376:12345-192.168.202.36@tcp:400: 00000100:00100000:3.0:1787579937.736221:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d661880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+5:2361:x1874413239669376:12345-192.168.202.36@tcp:400: Request processed in 93us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579937.736228:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 13 00000100:00100000:3.0:1787579937.736243:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 14 00000100:00100000:3.0:1787579937.736249:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d660380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+5:2361:x1874413239669248:12345-192.168.202.36@tcp:400: 00000100:00100000:3.0:1787579937.736271:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d660380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+5:2361:x1874413239669248:12345-192.168.202.36@tcp:400: Request processed in 23us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579937.736277:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 14 00000100:00080000:3.0:1787579937.736297:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787579937.736301:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787579937.736440:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239669120 00000100:00100000:2.0:1787579937.736445:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239669120 00000100:00100000:2.0:1787579937.736486:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 31 00000100:00100000:2.0:1787579937.736493:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d660000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:2361:x1874413239669120:12345-192.168.202.36@tcp:400: 00000100:00100000:2.0:1787579937.736524:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d660000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:2361:x1874413239669120:12345-192.168.202.36@tcp:400: Request processed in 31us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579937.736530:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 31 00000100:00100000:2.0:1787579937.736570:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239668992 00000100:00100000:2.0:1787579937.736574:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239668992 00000100:00100000:2.0:1787579937.736596:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 140 00000100:00100000:2.0:1787579937.736603:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5ba09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ff68ada-0c43-4367-93b7-ad31684360cf+8:2361:x1874413239668992:12345-192.168.202.36@tcp:400: 00000100:00100000:2.0:1787579937.736627:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5ba09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ff68ada-0c43-4367-93b7-ad31684360cf+8:2361:x1874413239668992:12345-192.168.202.36@tcp:400: Request processed in 25us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579937.736633:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 140 00000100:00080000:3.0:1787579937.736847:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787579937.737859:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5ba08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+14:5850:x1874413262763648:12345-0@lo:501: Request processed in 3066us (3148us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579937.737870:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787579937.738272:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5f813800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262763648:0@lo:501: 00000100:00100000:3.0:1787579937.738480:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d663480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262763776:0@lo:503: 00000100:00100000:3.0:1787579937.738534:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579937.738571:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae50fc2d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787579937.738642:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262763776 00000100:00100000:0.0:1787579937.738648:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262763776 00000100:00100000:0.0:1787579937.738681:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787579937.738689:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5ba08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+14:5850:x1874413262763776:12345-0@lo:503: 00000100:00100000:0.0:1787579937.738860:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5ba08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+14:5850:x1874413262763776:12345-0@lo:503: Request processed in 172us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579937.738867:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787579937.738995:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d663480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262763776:0@lo:503: 00000100:00100000:3.0:1787579937.739592:0:8472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d663480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:8472:1874413262763904:0@lo:502: 00000100:00100000:3.0:1787579937.739631:0:8472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579937.739658:0:8472:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae50fc2240 going to sleep for 11 seconds 00000100:00100000:0.0:1787579937.739695:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262763904 00000100:00100000:0.0:1787579937.739699:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262763904 00000100:00100000:0.0:1787579937.739767:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1787579937.739775:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5ba0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+14:8472:x1874413262763904:12345-0@lo:502: 00000100:00100000:0.0:1787579937.739948:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5ba0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+14:8472:x1874413262763904:12345-0@lo:502: Request processed in 173us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579937.739963:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787579937.740022:0:8472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d663480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:8472:1874413262763904:0@lo:502: 00000020:01000000:3.0:1787579937.740063:0:8472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787579937.740072:0:8472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787579937.740075:0:8472:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787579937.740079:0:8472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787579937.740099:0:8472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d663480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:8472:1874413262764032:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787579937.740130:0:8472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579937.744201:0:8472:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae50fc2240 going to sleep for 11 seconds 00000100:00100000:2.0:1787579937.744297:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262764032 00000100:00100000:2.0:1787579937.744362:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262764032 00000100:00100000:2.0:1787579937.744492:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787579937.744502:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5ba09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+14:8472:x1874413262764032:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787579937.744797:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5ba09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+14:8472:x1874413262764032:12345-0@lo:502:llog_process_th.0 Request processed in 295us (4664us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579937.744804:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787579937.744986:0:8472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d663480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:8472:1874413262764032:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787579937.745019:0:8472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787579937.745087:0:8472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787579937.745090:0:8472:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787579937.745094:0:8472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1787579937.745260:0:5850:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1787579937.745279:0:5850:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1787579937.745289:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae4ca59400/0xc86deac208337702 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208337709 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579937.745300:0:5850:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff8fae4ca59400/0xc86deac208337702 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208337709 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787579937.745658:0:5850:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787579937.745661:0:5850:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8fae50613000 from 39 10000000:01000000:0.0:1787579937.745664:0:5850:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787579937.745699:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae50fea200/0xc86deac208337710 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579937.745708:0:5850:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff8fae50fea200/0xc86deac208337710 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579937.745717:0:5850:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff8fae50fea200/0xc86deac208337710 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579937.745738:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7f5bb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262764160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787579937.745789:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579937.745854:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae48647540 going to sleep for 11 seconds 00000100:00100000:2.0:1787579937.745886:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262764160 00000100:00100000:2.0:1787579937.745892:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262764160 00000100:00100000:2.0:1787579937.745958:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787579937.745966:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5ba08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+14:5850:x1874413262764160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787579937.745977:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787579937.745989:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fae74ed9a00/0xc86deac208337717 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc86deac208337710 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579937.746025:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fae74ed9a00/0xc86deac208337717 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc86deac208337710 expref: 15 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579937.746047:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fae74ed9a00/0xc86deac208337717 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac208337710 expref: 15 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579937.746057:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae74ed9a00, rc 0) 00000100:00100000:2.0:1787579937.746096:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5ba08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+15:5850:x1874413262764160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579937.746102:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787579937.746167:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7f5bb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262764160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787579937.746180:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff8fae50fea200/0xc86deac208337710 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208337717 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579937.746189:0:5850:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff8fae50fea200/0xc86deac208337710 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc86deac208337717 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579937.746233:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d663480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262764288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787579937.746257:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579937.746521:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae50fc2240 going to sleep for 11 seconds 00000100:00100000:0.0:1787579937.746549:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262764288 00000100:00100000:0.0:1787579937.746554:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262764288 00000100:00100000:0.0:1787579937.746576:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787579937.746582:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5ba0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+15:5850:x1874413262764288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787579937.746974:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5ba0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+15:5850:x1874413262764288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 390us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579937.746988:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787579937.747136:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d663480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262764288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787579937.747180:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d663480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262764416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787579937.747219:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579937.747274:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae50fc2240 going to sleep for 11 seconds 00000100:00100000:2.0:1787579937.747311:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262764416 00000100:00100000:2.0:1787579937.747315:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262764416 00000100:00100000:2.0:1787579937.747473:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787579937.747483:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5ba0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+15:5850:x1874413262764416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787579937.747676:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5ba0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+15:5850:x1874413262764416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 194us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579937.747683:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787579937.747956:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d663480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262764416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787579937.748328:0:8473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d663480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:8473:1874413262764544:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787579937.748363:0:8473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579937.748497:0:8473:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae50fc29c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787579937.748547:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262764544 00000100:00100000:2.0:1787579937.748551:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262764544 00000100:00100000:2.0:1787579937.748580:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787579937.748587:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5ba0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+15:8473:x1874413262764544:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787579937.748799:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5ba0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+15:8473:x1874413262764544:12345-0@lo:502:llog_process_th.0 Request processed in 212us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579937.748807:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787579937.748878:0:8473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d663480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:8473:1874413262764544:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787579937.748916:0:8473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d663480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:8473:1874413262764672:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787579937.748948:0:8473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579937.748968:0:8473:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae50fc29c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787579937.749807:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262764672 00000100:00100000:1.0:1787579937.749813:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262764672 00000100:00100000:1.0:1787579937.752960:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787579937.752982:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+15:8473:x1874413262764672:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787579937.753754:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+15:8473:x1874413262764672:12345-0@lo:502:llog_process_th.0 Request processed in 780us (4803us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579937.753772:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1787579937.755375:0:8473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d663480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:8473:1874413262764672:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1787579937.755454:0:8473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1787579937.755676:0:5850:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1787579937.755695:0:5850:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787579937.755706:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae50fea200/0xc86deac208337710 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208337717 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579937.755718:0:5850:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff8fae50fea200/0xc86deac208337710 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208337717 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787579937.755729:0:5850:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1787579937.755732:0:5850:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:3.0:1787579937.755735:0:5850:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787579937.755776:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae4150f600/0xc86deac20833771e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579937.755785:0:5850:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff8fae4150f600/0xc86deac20833771e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579937.755795:0:5850:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff8fae4150f600/0xc86deac20833771e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579937.755831:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d661500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262764800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787579937.755891:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579937.756016:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae50fc2d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787579937.756110:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262764800 00000100:00100000:1.0:1787579937.756117:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262764800 00000100:00100000:1.0:1787579937.756162:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787579937.756172:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+15:5850:x1874413262764800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787579937.756184:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787579937.756197:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fae4ca58e00/0xc86deac208337725 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc86deac20833771e expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579937.756219:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fae4ca58e00/0xc86deac208337725 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc86deac20833771e expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579937.756228:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fae4ca58e00/0xc86deac208337725 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac20833771e expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579937.756237:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae4ca58e00, rc 0) 00000100:00100000:1.0:1787579937.756323:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+16:5850:x1874413262764800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579937.756330:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787579937.756463:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d661500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262764800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787579937.756475:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff8fae4150f600/0xc86deac20833771e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208337725 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579937.756484:0:5850:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff8fae4150f600/0xc86deac20833771e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc86deac208337725 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579937.756533:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d661500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262764928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787579937.756558:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579937.756619:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae50fc2d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787579937.756690:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262764928 00000100:00100000:1.0:1787579937.756695:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262764928 00000100:00100000:1.0:1787579937.756715:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787579937.756720:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+16:5850:x1874413262764928:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787579937.756982:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+16:5850:x1874413262764928:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 260us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579937.756989:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787579937.757055:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d661500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262764928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787579937.757082:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d661500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262765056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787579937.757119:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579937.757138:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae50fc2d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787579937.757192:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262765056 00000100:00100000:1.0:1787579937.757196:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262765056 00000100:00100000:1.0:1787579937.757216:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787579937.757221:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+16:5850:x1874413262765056:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787579937.757458:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+16:5850:x1874413262765056:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 234us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579937.757465:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787579937.757593:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d661500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262765056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787579937.757904:0:8474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5f813100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:8474:1874413262765184:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787579937.757941:0:8474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579937.758002:0:8474:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fad43647b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787579937.758063:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262765184 00000100:00100000:3.0:1787579937.758068:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262765184 00000100:00100000:3.0:1787579937.758089:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787579937.758096:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+16:8474:x1874413262765184:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787579937.758270:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+16:8474:x1874413262765184:12345-0@lo:502:llog_process_th.0 Request processed in 173us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579937.758286:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787579937.758372:0:8474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5f813100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:8474:1874413262765184:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787579937.758501:0:8474:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787579937.758513:0:8474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787579937.758515:0:8474:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787579937.758521:0:8474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787579937.758543:0:8474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5f813100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:8474:1874413262765312:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787579937.758576:0:8474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579937.758593:0:8474:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fad43647b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787579937.758647:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262765312 00000100:00100000:3.0:1787579937.758651:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262765312 00000100:00100000:3.0:1787579937.758670:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787579937.758677:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+16:8474:x1874413262765312:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787579937.758796:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+16:8474:x1874413262765312:12345-0@lo:502:llog_process_th.0 Request processed in 119us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579937.758803:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787579937.758874:0:8474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5f813100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:8474:1874413262765312:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787579937.758891:0:8474:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787579937.758896:0:8474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787579937.758897:0:8474:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787579937.758900:0:8474:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:3.0:1787579937.759005:0:5850:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1787579937.759021:0:5850:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1787579937.759029:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae4150f600/0xc86deac20833771e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208337725 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579937.759039:0:5850:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff8fae4150f600/0xc86deac20833771e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208337725 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787579937.759049:0:5850:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787579937.759052:0:5850:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8fae6a238800 from 39 10000000:01000000:3.0:1787579937.759055:0:5850:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787579937.759079:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae4150fa00/0xc86deac20833772c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579937.759087:0:5850:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff8fae4150fa00/0xc86deac20833772c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579937.759094:0:5850:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff8fae4150fa00/0xc86deac20833772c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579937.759103:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d661500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262765440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787579937.759127:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579937.759158:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae50fc2e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787579937.759178:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262765440 00000100:00100000:2.0:1787579937.759182:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262765440 00000100:00100000:2.0:1787579937.759252:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787579937.759259:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+16:5850:x1874413262765440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787579937.759270:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787579937.759280:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fae74ed8400/0xc86deac208337733 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc86deac20833772c expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579937.759302:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fae74ed8400/0xc86deac208337733 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc86deac20833772c expref: 17 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579937.759311:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fae74ed8400/0xc86deac208337733 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac20833772c expref: 17 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579937.759320:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae74ed8400, rc 0) 00000100:00100000:2.0:1787579937.759356:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+17:5850:x1874413262765440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579937.759403:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d661500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262765440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787579937.759414:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff8fae4150fa00/0xc86deac20833772c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208337733 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579937.759422:0:5850:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff8fae4150fa00/0xc86deac20833772c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc86deac208337733 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579937.759464:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5f813100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262765568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787579937.759527:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787579937.759683:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579937.759736:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262765568 00000100:00100000:0.0:1787579937.759741:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262765568 00000100:00100000:1.0:1787579937.759749:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fad43647b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787579937.759760:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787579937.759766:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+17:5850:x1874413262765568:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787579937.759994:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+17:5850:x1874413262765568:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 227us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579937.760001:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787579937.760008:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5f813100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262765568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787579937.760041:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5f813100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262765696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787579937.760069:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579937.760083:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fad43647b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787579937.760097:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262765696 00000100:00100000:0.0:1787579937.760101:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262765696 00000100:00100000:3.0:1787579937.760117:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787579937.760125:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+17:5850:x1874413262765696:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787579937.760284:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+17:5850:x1874413262765696:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 160us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579937.760288:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787579937.760378:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5f813100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262765696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787579937.761230:0:8475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d663b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:8475:1874413262765824:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787579937.761271:0:8475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579937.761310:0:8475:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae5dd21300 going to sleep for 11 seconds 00000100:00100000:0.0:1787579937.762162:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262765824 00000100:00100000:0.0:1787579937.762170:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262765824 00000100:00100000:0.0:1787579937.762211:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787579937.762219:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+17:8475:x1874413262765824:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787579937.763254:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+17:8475:x1874413262765824:12345-0@lo:502:llog_process_th.0 Request processed in 1031us (1977us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579937.763264:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787579937.763348:0:8475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d663b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:8475:1874413262765824:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787579937.766570:0:8475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d663b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:8475:1874413262765952:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787579937.766679:0:8475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579937.766794:0:8475:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae5dd21300 going to sleep for 11 seconds 00000100:00100000:1.0:1787579937.766822:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262765952 00000100:00100000:1.0:1787579937.766833:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262765952 00000100:00100000:1.0:1787579937.766940:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787579937.766950:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+17:8475:x1874413262765952:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787579937.767253:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+17:8475:x1874413262765952:12345-0@lo:502:llog_process_th.0 Request processed in 303us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579937.767262:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787579937.767346:0:8475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d663b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:8475:1874413262765952:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1787579937.767376:0:8475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1787579937.767763:0:5850:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1787579937.767782:0:5850:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787579937.767792:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae4150fa00/0xc86deac20833772c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208337733 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579937.767804:0:5850:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff8fae4150fa00/0xc86deac20833772c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208337733 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787579937.767826:0:5850:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1787579937.767828:0:5850:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1787579937.767831:0:5850:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787579937.767858:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae50fea600/0xc86deac20833773a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579937.767866:0:5850:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff8fae50fea600/0xc86deac20833773a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579937.767887:0:5850:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff8fae50fea600/0xc86deac20833773a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579937.767905:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7f5b9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262766080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787579937.767937:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579937.769762:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae50fc2240 going to sleep for 11 seconds 00000100:00100000:2.0:1787579937.770316:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262766080 00000100:00100000:2.0:1787579937.770327:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262766080 00000100:00100000:2.0:1787579937.770379:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787579937.770415:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+17:5850:x1874413262766080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787579937.770438:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787579937.770461:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fae74ed9000/0xc86deac208337741 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc86deac20833773a expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579937.771181:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fae74ed9000/0xc86deac208337741 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc86deac20833773a expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579937.771197:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fae74ed9000/0xc86deac208337741 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac20833773a expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579937.771228:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae74ed9000, rc 0) 00000100:00100000:2.0:1787579937.771308:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+18:5850:x1874413262766080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 896us (3370us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579937.771315:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787579937.771903:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7f5b9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262766080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787579937.771921:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff8fae50fea600/0xc86deac20833773a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208337741 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579937.771931:0:5850:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff8fae50fea600/0xc86deac20833773a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc86deac208337741 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579937.772004:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7f5b9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262766208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787579937.772052:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579937.772080:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae50fc2240 going to sleep for 11 seconds 00000100:00100000:2.0:1787579937.772298:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262766208 00000100:00100000:2.0:1787579937.772305:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262766208 00000100:00100000:2.0:1787579937.772331:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787579937.772339:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+18:5850:x1874413262766208:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787579937.772966:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+18:5850:x1874413262766208:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 626us (913us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579937.772975:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787579937.773013:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7f5b9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262766208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787579937.773118:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae77aa9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262766336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787579937.773170:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579937.773187:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae455a9b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787579937.773200:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262766336 00000100:00100000:2.0:1787579937.773204:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262766336 00000100:00100000:2.0:1787579937.773224:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787579937.773230:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+18:5850:x1874413262766336:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787579937.773374:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+18:5850:x1874413262766336:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 143us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579937.773402:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787579937.773437:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae77aa9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262766336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787579937.774323:0:8476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5f813100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:8476:1874413262766464:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787579937.774372:0:8476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579937.774621:0:8476:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fad43647240 going to sleep for 11 seconds 00000100:00100000:2.0:1787579937.774654:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262766464 00000100:00100000:2.0:1787579937.774665:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262766464 00000100:00100000:2.0:1787579937.774727:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787579937.774735:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+18:8476:x1874413262766464:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787579937.775020:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+18:8476:x1874413262766464:12345-0@lo:502:llog_process_th.0 Request processed in 285us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579937.775121:0:8476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5f813100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:8476:1874413262766464:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787579937.775149:0:8476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787579937.775168:0:8476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787579937.775171:0:8476:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787579937.775177:0:8476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787579937.775199:0:8476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d663b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:8476:1874413262766592:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787579937.775234:0:8476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579937.775254:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787579937.775344:0:8476:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae5dd21300 going to sleep for 11 seconds 00000100:00100000:2.0:1787579937.775421:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262766592 00000100:00100000:2.0:1787579937.775425:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262766592 00000100:00100000:1.0:1787579937.775628:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787579937.775638:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+18:8476:x1874413262766592:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787579937.775829:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+18:8476:x1874413262766592:12345-0@lo:502:llog_process_th.0 Request processed in 193us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579937.775837:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787579937.775898:0:8476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d663b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:8476:1874413262766592:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787579937.775917:0:8476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787579937.775922:0:8476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787579937.775924:0:8476:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787579937.775927:0:8476:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1787579937.777141:0:5850:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:2.0:1787579937.777177:0:5850:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787579937.777187:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae50fea600/0xc86deac20833773a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208337741 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579937.777200:0:5850:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff8fae50fea600/0xc86deac20833773a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208337741 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787579937.777211:0:5850:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1787579937.777214:0:5850:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8fae503119b8 from 1 10000000:01000000:2.0:1787579937.777217:0:5850:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787579937.777247:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae74ed8a00/0xc86deac208337748 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579937.777255:0:5850:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff8fae74ed8a00/0xc86deac208337748 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579937.777265:0:5850:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff8fae74ed8a00/0xc86deac208337748 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579937.777282:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae77aa9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262766720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787579937.777326:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579937.777429:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae455a9600 going to sleep for 11 seconds 00000100:00100000:1.0:1787579937.777945:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262766720 00000100:00100000:1.0:1787579937.777952:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262766720 00000100:00100000:1.0:1787579937.777984:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787579937.777991:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+18:5850:x1874413262766720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787579937.778003:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787579937.778015:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fae4ca59c00/0xc86deac20833774f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xc86deac208337748 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579937.778206:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fae4ca59c00/0xc86deac20833774f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc86deac208337748 expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579937.778218:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fae4ca59c00/0xc86deac20833774f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac208337748 expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579937.778227:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae4ca59c00, rc 0) 00000100:00100000:1.0:1787579937.778274:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:5850:x1874413262766720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 282us (947us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579937.778281:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1787579937.778355:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae77aa9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262766720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787579937.778369:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff8fae74ed8a00/0xc86deac208337748 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac20833774f expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579937.778378:0:5850:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff8fae74ed8a00/0xc86deac208337748 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc86deac20833774f expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579937.778459:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae77aa9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262766848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787579937.778613:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579937.778645:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae455a9600 going to sleep for 11 seconds 00000100:00100000:3.0:1787579937.778687:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262766848 00000100:00100000:3.0:1787579937.778692:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262766848 00000100:00100000:3.0:1787579937.778717:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1787579937.778725:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:5850:x1874413262766848:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787579937.779009:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:5850:x1874413262766848:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 284us (523us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787579937.779017:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1787579937.780288:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae77aa9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262766848:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1787579937.780329:0:5850:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787579937.780338:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae74ed8a00/0xc86deac208337748 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac20833774f expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579937.780348:0:5850:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff8fae74ed8a00/0xc86deac208337748 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac20833774f expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579938.291625:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579939.318305:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579940.340717:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787579940.979896:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae77aa9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874413262766976:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787579940.979988:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579940.980157:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262766976 00000100:00100000:2.0:1787579940.980166:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262766976 00000100:00100000:2.0:1787579940.980245:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787579940.980257:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d663b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874413262766976:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787579940.980286:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1787579940.980295:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787579940.980359:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d663b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874413262766976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579940.980366:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1787579940.980444:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae77aa9f80 x1874413262766976/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787579956 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787579940.980465:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae77aa9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874413262766976:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787579941.367619:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787579941.494246:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5f812680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1874413262767360:0@lo:400:kworker.0 00000100:00100000:0.0:1787579941.494329:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579941.494435:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787579941.494441:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5f812d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874413262767232:0@lo:400:kworker.0 00000100:00100000:0.0:1787579941.494465:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579941.495559:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262767360 00000100:00100000:3.0:1787579941.495569:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262767360 00000100:00100000:3.0:1787579941.495835:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262767232 00000100:00100000:3.0:1787579941.495840:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262767232 00000100:00100000:3.0:1787579941.495860:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787579941.495869:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7f5b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874413262767360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787579941.495943:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7f5b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874413262767360:12345-0@lo:400:kworker.0 Request processed in 74us (1613us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579941.495950:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787579941.495968:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787579941.495974:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7f5b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874413262767232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787579941.496002:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7f5b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874413262767232:12345-0@lo:400:kworker.0 Request processed in 29us (1536us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579941.496008:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787579941.496033:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5f811180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3315:1874413262767104:0@lo:400:kworker.0 00000100:00100000:2.0:1787579941.496186:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5f812a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262767744:0@lo:400:kworker.0 00000100:00080000:1.0:1787579941.496831:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787579941.496861:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5f811c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874413262767488:0@lo:400:kworker.0 00000100:00100000:0.0:1787579941.502329:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5f812d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874413262767232:0@lo:400:kworker.0 00000100:00100000:0.0:1787579941.502455:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5f812680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1874413262767360:0@lo:400:kworker.0 00000100:00100000:2.0:1787579941.506143:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579941.506633:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579941.506668:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5f811f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1874413262767616:0@lo:400:kworker.0 00000100:00100000:3.0:1787579941.506706:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579941.506744:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262767616 00000100:00100000:3.0:1787579941.506762:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262767616 00000100:00100000:3.0:1787579941.506846:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787579941.506856:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d660a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874413262767616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787579941.507131:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262767104 00000100:00100000:2.0:1787579941.507136:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262767104 00000100:00100000:2.0:1787579941.507175:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1787579941.507183:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:3315:x1874413262767104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787579941.507226:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:3315:x1874413262767104:12345-0@lo:400:kworker.0 Request processed in 44us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579941.507235:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1787579941.507282:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5f811180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3315:1874413262767104:0@lo:400:kworker.0 00000100:00080000:2.0:1787579941.507459:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787579941.507648:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d660a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874413262767616:12345-0@lo:400:kworker.0 Request processed in 793us (940us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579941.507655:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787579941.507725:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5f811f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1874413262767616:0@lo:400:kworker.0 00000100:00100000:1.0:1787579941.507809:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579941.508069:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262767744 00000100:00100000:3.0:1787579941.508074:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262767744 00000100:00100000:3.0:1787579941.508170:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262767488 00000100:00100000:3.0:1787579941.508174:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262767488 00000100:00100000:3.0:1787579941.508192:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787579941.508200:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae77aaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262767744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787579941.508242:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae77aaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262767744:12345-0@lo:400:kworker.0 Request processed in 43us (2108us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579941.508262:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787579941.508444:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787579941.508466:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5f812300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874413262767488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787579941.508531:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5f812300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874413262767488:12345-0@lo:400:kworker.0 Request processed in 68us (711us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579941.508538:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1787579941.508587:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae5f811c00 x1874413262767488/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787579957 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787579941.508630:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5f811c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874413262767488:0@lo:400:kworker.0 00010000:00080000:3.0:1787579941.508845:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae5f812a00 x1874413262767744/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787579957 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787579941.508856:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5f812a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262767744:0@lo:400:kworker.0 00000100:00080000:2.0:1787579941.509219:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787579942.005308:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787579942.005336:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d663800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262767872:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787579942.005434:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579942.007261:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262767872 00000100:00100000:3.0:1787579942.007273:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262767872 00000100:00100000:3.0:1787579942.007349:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787579942.007361:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae77aaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262767872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787579942.007439:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787579942.007515:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae77aaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262767872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 155us (2079us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579942.007522:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1787579942.007901:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae6d663800 x1874413262767872/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787579958 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787579942.007924:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d663800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262767872:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787579942.387619:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787579942.857959:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787579942.858023:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787579942.858063:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787579942.858252:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239669504 00000100:00100000:3.0:1787579942.858265:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239669504 00000100:00100000:3.0:1787579942.858352:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 167 00000100:00100000:3.0:1787579942.858365:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ff68ada-0c43-4367-93b7-ad31684360cf+8:2359:x1874413239669504:12345-192.168.202.36@tcp:400: 00000100:00100000:3.0:1787579942.858497:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ff68ada-0c43-4367-93b7-ad31684360cf+8:2359:x1874413239669504:12345-192.168.202.36@tcp:400: Request processed in 134us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579942.858505:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 167 00000100:00100000:2.0:1787579942.859069:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239669888 00000100:00100000:2.0:1787579942.859076:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239669888 00000100:00100000:2.0:1787579942.859142:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 17 00000100:00100000:2.0:1787579942.859150:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5f810700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+5:2359:x1874413239669888:12345-192.168.202.36@tcp:400: 00000100:00100000:2.0:1787579942.859193:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5f810700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+5:2359:x1874413239669888:12345-192.168.202.36@tcp:400: Request processed in 43us (1169us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579942.859201:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 17 00000100:00100000:0.0:1787579942.859601:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239669632 00000100:00100000:0.0:1787579942.859607:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239669632 00000100:00100000:0.0:1787579942.859648:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 35 00000100:00100000:0.0:1787579942.859656:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5f811c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:2359:x1874413239669632:12345-192.168.202.36@tcp:400: 00000100:00100000:0.0:1787579942.859692:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5f811c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:2359:x1874413239669632:12345-192.168.202.36@tcp:400: Request processed in 36us (1745us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579942.859699:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 35 00000100:00100000:1.0:1787579942.859779:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787579942.859948:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239669760 00000100:00100000:0.0:1787579942.859952:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239669760 00000100:00100000:0.0:1787579942.860002:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 18 00000100:00100000:0.0:1787579942.860010:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5f810e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+5:2359:x1874413239669760:12345-192.168.202.36@tcp:400: 00000100:00100000:0.0:1787579942.860045:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5f810e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+5:2359:x1874413239669760:12345-192.168.202.36@tcp:400: Request processed in 35us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579942.860051:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 18 00000100:00080000:3.0:1787579942.861213:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787579942.861221:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787579942.861225:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787579943.367892:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787579943.368604:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239670016 00000100:00100000:3.0:1787579943.368617:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239670016 00000100:00100000:3.0:1787579943.368686:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 168 00000100:00100000:3.0:1787579943.368716:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ff68ada-0c43-4367-93b7-ad31684360cf+8:5603:x1874413239670016:12345-192.168.202.36@tcp:101: 00010000:00010000:3.0:1787579943.368751:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787579943.368772:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fae4150e400/0xc86deac208337756 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xf454739e86a9cfe8 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579943.368805:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fae4150e400/0xc86deac208337756 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9cfe8 expref: 9 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579943.368818:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fae4150e400/0xc86deac208337756 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9cfe8 expref: 9 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579943.368828:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae4150e400, rc 0) 00000100:00100000:3.0:1787579943.368901:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ff68ada-0c43-4367-93b7-ad31684360cf+9:5603:x1874413239670016:12345-192.168.202.36@tcp:101: Request processed in 189us (1021us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579943.368908:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 168 00000100:00100000:3.0:1787579943.374255:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787579943.374461:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239670144 00000100:00100000:2.0:1787579943.374471:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239670144 00000100:00100000:2.0:1787579943.374528:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 169 00000100:00100000:2.0:1787579943.374556:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ff68ada-0c43-4367-93b7-ad31684360cf+9:5603:x1874413239670144:12345-192.168.202.36@tcp:501: 00000100:00100000:2.0:1787579943.375088:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ff68ada-0c43-4367-93b7-ad31684360cf+9:5603:x1874413239670144:12345-192.168.202.36@tcp:501: Request processed in 534us (855us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579943.375097:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 169 00000100:00100000:2.0:1787579943.381625:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787579943.381716:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239670272 00000100:00100000:0.0:1787579943.381731:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239670272 00000100:00100000:0.0:1787579943.381797:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 170 00000100:00100000:0.0:1787579943.381826:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ff68ada-0c43-4367-93b7-ad31684360cf+9:5603:x1874413239670272:12345-192.168.202.36@tcp:503: 00000100:00100000:0.0:1787579943.382159:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ff68ada-0c43-4367-93b7-ad31684360cf+9:5603:x1874413239670272:12345-192.168.202.36@tcp:503: Request processed in 333us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579943.382168:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 170 00000100:00100000:1.0:1787579943.390005:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787579943.390195:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239670400 00000100:00100000:3.0:1787579943.390206:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239670400 00000100:00100000:3.0:1787579943.390343:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 171 00000100:00100000:3.0:1787579943.390354:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ff68ada-0c43-4367-93b7-ad31684360cf+9:6106:x1874413239670400:12345-192.168.202.36@tcp:502: 00000100:00100000:3.0:1787579943.390852:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ff68ada-0c43-4367-93b7-ad31684360cf+9:6106:x1874413239670400:12345-192.168.202.36@tcp:502: Request processed in 498us (860us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579943.390861:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 171 00000100:00100000:0.0:1787579943.395629:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787579943.395747:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239670528 00000100:00100000:3.0:1787579943.395758:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239670528 00000100:00100000:3.0:1787579943.395845:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 172 00000100:00100000:3.0:1787579943.395856:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ff68ada-0c43-4367-93b7-ad31684360cf+9:6106:x1874413239670528:12345-192.168.202.36@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787579943.396217:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ff68ada-0c43-4367-93b7-ad31684360cf+9:6106:x1874413239670528:12345-192.168.202.36@tcp:502:llog_process_th.0 Request processed in 362us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579943.396226:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 172 00000100:00100000:1.0:1787579943.401055:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787579943.401649:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239670656 00000100:00100000:3.0:1787579943.401663:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239670656 00000100:00100000:3.0:1787579943.401729:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 173 00000100:00100000:3.0:1787579943.401740:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ff68ada-0c43-4367-93b7-ad31684360cf+9:5603:x1874413239670656:12345-192.168.202.36@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787579943.401759:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787579943.401778:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fae4150f000/0xc86deac20833775d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xf454739e86a9cfef expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579943.401809:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fae4150f000/0xc86deac20833775d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9cfef expref: 10 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579943.401821:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fae4150f000/0xc86deac20833775d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9cfef expref: 10 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579943.401830:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae4150f000, rc 0) 00000100:00100000:3.0:1787579943.401950:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ff68ada-0c43-4367-93b7-ad31684360cf+10:5603:x1874413239670656:12345-192.168.202.36@tcp:101:ll_cfg_requeue.0 Request processed in 211us (909us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579943.401959:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 173 00000100:00100000:1.0:1787579943.407763:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787579943.407869:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239670784 00000100:00100000:3.0:1787579943.407879:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239670784 00000100:00100000:3.0:1787579943.408200:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 174 00000100:00100000:3.0:1787579943.408212:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ff68ada-0c43-4367-93b7-ad31684360cf+10:5603:x1874413239670784:12345-192.168.202.36@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787579943.408721:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ff68ada-0c43-4367-93b7-ad31684360cf+10:5603:x1874413239670784:12345-192.168.202.36@tcp:501:ll_cfg_requeue.0 Request processed in 508us (965us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787579943.408738:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 174 00010000:00010000:3.0:1787579943.411532:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579944.435755:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579945.460242:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787579946.132690:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787579946.132725:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7f5bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874413262768000:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787579946.132797:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579946.132928:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262768000 00000100:00100000:0.0:1787579946.132936:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262768000 00000100:00100000:0.0:1787579946.132988:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787579946.132997:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7f5bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874413262768000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787579946.133034:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787579946.133091:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7f5bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874413262768000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579946.133099:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1787579946.133139:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae7f5bb800 x1874413262768000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787579962 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787579946.133158:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7f5bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874413262768000:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787579946.133191:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:2.0:1787579946.210978:0:8515:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd596b9d10 20000000:00000080:2.0:1787579946.210999:0:8515:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8fae5f6c0000 uarg=0000000000000000 20000000:01000000:2.0:1787579946.211041:0:8515:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787579946.211047:0:8515:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787579946.211052:0:8515:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1787579946.216039:0:8516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:3.0:1787579946.216362:0:8515:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:3.0:1787579946.230380:0:8515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:3.0:1787579946.230475:0:8515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:3.0:1787579946.230646:0:8515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:3.0:1787579946.230666:0:8515:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787579946.230686:0:8515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8fae4150fe00/0xc86deac208337764 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579946.230874:0:8515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fae50feb800/0xc86deac2083374d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac2083374d2 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579946.230882:0:8515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fae4ca59e00/0xc86deac20833753b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac208337534 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579946.230888:0:8515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fae50fea000/0xc86deac208337606 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac2083375ff expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579946.230898:0:8515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fae74ed9c00/0xc86deac2083376c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9cfb7 expref: 9 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579946.230905:0:8515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8fae4150fe00/0xc86deac208337764 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579946.230952:0:8515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fae74ed9c00/0xc86deac2083376c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9cfb7 expref: 9 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579946.231180:0:8515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8fae74ed9c00/0xc86deac2083376c3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9cfb7 expref: 9 pid: 5848 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579946.231198:0:8515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d663800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8515:1874413262768128:192.168.202.36@tcp:104: 00010000:00010000:3.0:1787579946.231316:0:8515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fae50fea000/0xc86deac208337606 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc86deac2083375ff expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579946.231326:0:8515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fae50fea000/0xc86deac208337606 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc86deac2083375ff expref: 18 pid: 5848 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579946.231335:0:8515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d661500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8515:1874413262768256:0@lo:104: 00000100:00100000:3.0:1787579946.231381:0:8515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787579946.231448:0:8515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fae4ca59e00/0xc86deac20833753b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc86deac208337534 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579946.231457:0:8515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fae4ca59e00/0xc86deac20833753b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc86deac208337534 expref: 18 pid: 5845 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579946.231466:0:8515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d660e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8515:1874413262768384:0@lo:104: 00000100:00100000:2.0:1787579946.231702:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262768256 00000100:00100000:2.0:1787579946.231711:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262768256 00000100:00100000:2.0:1787579946.231766:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787579946.231777:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d663480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+3:8515:x1874413262768256:12345-0@lo:104: 00010000:00010000:2.0:1787579946.231790:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.136@tcp lock: ffff8fae4ca58600/0xc86deac2083375ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc86deac208337606 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579946.231847:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787579946.231853:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d663480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+3:8515:x1874413262768256:12345-0@lo:104: Request processed in 78us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579946.231860:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:2.0:1787579946.231884:0:7642:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787579946.231891:0:7642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.136@tcp lock: ffff8fae4ca58600/0xc86deac2083375ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc86deac208337606 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579946.231899:0:7642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae4ca58600 already unused, calling callback (ffffffffc1b77c20) 10000000:00010000:2.0:1787579946.231903:0:7642:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.136@tcp lock: ffff8fae4ca58600/0xc86deac2083375ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc86deac208337606 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579946.231920:0:7642:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: ffff8fae4ca58600/0xc86deac2083375ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc86deac208337606 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787579946.231928:0:7642:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: ffff8fae4ca58600/0xc86deac2083375ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc86deac208337606 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787579946.231947:0:7642:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787579946.231976:0:7642:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.136@tcp lock: ffff8fae4ca58600/0xc86deac2083375ff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac208337606 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579946.231983:0:7642:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787579946.232003:0:7642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.136@tcp lock: ffff8fae4ca58600/0xc86deac2083375ff lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac208337606 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579946.232010:0:7642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: ffff8fae4ca58600/0xc86deac2083375ff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac208337606 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579946.232022:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579946.232023:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579946.232025:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787579946.232043:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae77aa9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3315:1874413262768512:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787579946.232072:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579946.232122:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262768512 00000100:00100000:2.0:1787579946.232126:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262768512 00010000:00010000:2.0:1787579946.232144:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fae50fea000/0xc86deac208337606 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc86deac2083375ff expref: 19 pid: 5848 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579946.232164:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787579946.232171:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae77aa9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:3315:x1874413262768512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787579946.232188:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787579946.232193:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fae50fea000/0xc86deac208337606 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc86deac2083375ff expref: 19 pid: 5848 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579946.232202:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fae50fea000/0xc86deac208337606 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc86deac2083375ff expref: 19 pid: 5848 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579946.232218:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787579946.232245:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae77aa9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:3315:x1874413262768512:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579946.232251:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787579946.232287:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae77aa9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3315:1874413262768512:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787579946.236407:0:8515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579946.236553:0:5836:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787579946.236575:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262768384 00000100:00100000:1.0:1787579946.236584:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262768384 00010000:00010000:3.0:1787579946.236641:0:8515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fae50feb800/0xc86deac2083374d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc86deac2083374d2 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579946.236645:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787579946.236659:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74f0a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+3:8515:x1874413262768384:12345-0@lo:104: 00010000:00010000:3.0:1787579946.236663:0:8515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fae50feb800/0xc86deac2083374d9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc86deac2083374d2 expref: 18 pid: 5845 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579946.236676:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.136@tcp lock: ffff8fae41661600/0xc86deac208337534 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc86deac20833753b expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579946.236681:0:8515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d662300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8515:1874413262768640:0@lo:104: 00010000:00010000:1.0:1787579946.236747:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787579946.236753:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74f0a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+3:8515:x1874413262768384:12345-0@lo:104: Request processed in 98us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579946.236761:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:1.0:1787579946.236805:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787579946.236812:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.136@tcp lock: ffff8fae41661600/0xc86deac208337534 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc86deac20833753b expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579946.236820:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae41661600 already unused, calling callback (ffffffffc1b77c20) 10000000:00010000:1.0:1787579946.236825:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.136@tcp lock: ffff8fae41661600/0xc86deac208337534 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc86deac20833753b expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579946.236849:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: ffff8fae41661600/0xc86deac208337534 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc86deac20833753b expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787579946.236856:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: ffff8fae41661600/0xc86deac208337534 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc86deac20833753b expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787579946.236862:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787579946.236888:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.136@tcp lock: ffff8fae41661600/0xc86deac208337534 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac20833753b expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579946.236895:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787579946.236915:0:8515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787579946.236930:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.136@tcp lock: ffff8fae41661600/0xc86deac208337534 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac20833753b expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579946.236950:0:8515:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae487606c0 going to sleep for 11 seconds 00010000:00010000:3.0:1787579946.237182:0:8515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fae50fea000/0xc86deac208337606 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc86deac2083375ff expref: 18 pid: 5848 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579946.237199:0:8515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d661500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8515:1874413262768256:0@lo:104: 00000100:00100000:3.0:1787579946.237214:0:8515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d660e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8515:1874413262768384:0@lo:104: 00000100:00100000:2.0:1787579946.237377:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787579946.237503:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239670912 00000100:00100000:2.0:1787579946.237508:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239670912 00010000:00010000:2.0:1787579946.237531:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fae74ed9c00/0xc86deac2083376c3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9cfb7 expref: 10 pid: 5848 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579946.237557:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 22 00000100:00100000:2.0:1787579946.237565:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae77aa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ff68ada-0c43-4367-93b7-ad31684360cf+10:2360:x1874413239670912:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787579946.237578:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787579946.237583:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fae74ed9c00/0xc86deac2083376c3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9cfb7 expref: 10 pid: 5848 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579946.237594:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fae74ed9c00/0xc86deac2083376c3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9cfb7 expref: 10 pid: 5848 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579946.237612:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787579946.237658:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae77aa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ff68ada-0c43-4367-93b7-ad31684360cf+10:2360:x1874413239670912:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 94us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579946.237666:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 22 00000100:00100000:0.0:1787579946.238565:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5f811500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3316:1874413262768768:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787579946.238608:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579946.238673:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262768640 00000100:00100000:0.0:1787579946.238679:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262768640 00000100:00100000:0.0:1787579946.238707:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787579946.238715:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d662680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+3:8515:x1874413262768640:12345-0@lo:104: 00010000:00010000:0.0:1787579946.238736:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.136@tcp lock: ffff8fae4150ec00/0xc86deac2083374d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc86deac2083374d9 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579946.238781:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:1.0:1787579946.239203:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: ffff8fae41661600/0xc86deac208337534 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac20833753b expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579946.239218:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787579946.239223:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.136@tcp lock: ffff8fae4150ec00/0xc86deac2083374d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc86deac2083374d9 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579946.239229:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae4150ec00 already unused, calling callback (ffffffffc1b77c20) 10000000:00010000:1.0:1787579946.239232:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.136@tcp lock: ffff8fae4150ec00/0xc86deac2083374d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc86deac2083374d9 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579946.239239:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: ffff8fae4150ec00/0xc86deac2083374d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc86deac2083374d9 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787579946.239247:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: ffff8fae4150ec00/0xc86deac2083374d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc86deac2083374d9 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787579946.239259:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787579946.239289:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.136@tcp lock: ffff8fae4150ec00/0xc86deac2083374d2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac2083374d9 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579946.239295:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787579946.239308:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.136@tcp lock: ffff8fae4150ec00/0xc86deac2083374d2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac2083374d9 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579946.239313:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: ffff8fae4150ec00/0xc86deac2083374d2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac2083374d9 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579946.239325:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787579946.239326:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787579946.239328:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787579946.239810:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262768768 00000100:00100000:2.0:1787579946.239817:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262768768 00010000:00010000:2.0:1787579946.239843:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fae4ca59e00/0xc86deac20833753b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc86deac208337534 expref: 18 pid: 5845 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579946.239868:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787579946.239875:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7f5bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+18:3316:x1874413262768768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787579946.239886:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787579946.239891:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fae4ca59e00/0xc86deac20833753b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc86deac208337534 expref: 18 pid: 5845 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579946.239915:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fae4ca59e00/0xc86deac20833753b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc86deac208337534 expref: 18 pid: 5845 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579946.239929:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fae4ca59e00/0xc86deac20833753b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc86deac208337534 expref: 18 pid: 5845 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579946.239941:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787579946.239981:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7f5bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+17:3316:x1874413262768768:12345-0@lo:103:ldlm_bl.0 Request processed in 106us (1372us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579946.239988:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:3.0:1787579946.240195:0:8515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fae74ed9c00/0xc86deac2083376c3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9cfb7 expref: 9 pid: 5848 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787579946.240207:0:8515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d663800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8515:1874413262768128:192.168.202.36@tcp:104: 00000100:00100000:3.0:1787579946.240219:0:8515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d662300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8515:1874413262768640:0@lo:104: 00010000:00010000:3.0:1787579946.240248:0:8515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8fae4150fe00/0xc86deac208337764 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579946.240310:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d662680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+3:8515:x1874413262768640:12345-0@lo:104: Request processed in 74us (1875us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579946.240319:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1787579946.240340:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787579946.240351:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5f813b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3317:1874413262768896:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787579946.240924:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5f811500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3316:1874413262768768:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787579946.241364:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579946.241571:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262768896 00000100:00100000:2.0:1787579946.241578:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262768896 00010000:00010000:2.0:1787579946.241605:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fae50feb800/0xc86deac2083374d9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc86deac2083374d2 expref: 17 pid: 5845 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579946.241636:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787579946.241653:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7f35dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+17:3317:x1874413262768896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787579946.241665:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787579946.241671:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fae50feb800/0xc86deac2083374d9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc86deac2083374d2 expref: 17 pid: 5845 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579946.241682:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fae50feb800/0xc86deac2083374d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc86deac2083374d2 expref: 17 pid: 5845 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579946.241696:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fae50feb800/0xc86deac2083374d9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc86deac2083374d2 expref: 17 pid: 5845 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579946.241707:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8fae4150fe00/0xc86deac208337764 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579946.241715:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fae4150fe00/0xc86deac208337764 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579946.241729:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fae4150fe00/0xc86deac208337764 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579946.241737:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fae4150fe00/0xc86deac208337764 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579946.241744:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8fae4150fe00/0xc86deac208337764 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579946.241750:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8fae4150fe00/0xc86deac208337764 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579946.241755:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae4150fe00 already unused, calling callback (ffffffffc155a230) 00010000:00010000:2.0:1787579946.241759:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8fae4150fe00/0xc86deac208337764 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579946.241772:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8fae4150fe00/0xc86deac208337764 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579946.241785:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8fae4150fe00/0xc86deac208337764 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579946.241795:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787579946.241861:0:8515:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8fae4150fe00/0xc86deac208337764 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579946.241868:0:8515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8fae4150fe00/0xc86deac208337764 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579946.241875:0:8515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fae4150fe00/0xc86deac208337764 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787579946.244297:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7f35dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+16:3317:x1874413262768896:12345-0@lo:103:ldlm_bl.0 Request processed in 2635us (2924us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579946.244313:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787579946.252452:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5f813b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3317:1874413262768896:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787579946.484590:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787579946.612070:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae77aab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3314:1874413262769024:0@lo:400:kworker.0 00000100:00100000:0.0:1787579946.612201:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579946.612271:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5f4ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874413262769536:0@lo:400:kworker.0 00000100:00100000:0.0:1787579946.612326:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579946.612367:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787579946.612374:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5f4af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874413262769152:0@lo:400:kworker.0 00000100:00100000:0.0:1787579946.612438:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579946.612464:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5ff1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874413262769664:0@lo:400:kworker.0 00000100:00100000:0.0:1787579946.612497:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579946.612539:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262769536 00000100:00100000:0.0:1787579946.612550:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262769536 00000100:00100000:0.0:1787579946.612618:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262769152 00000100:00100000:0.0:1787579946.612623:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262769152 00000100:00100000:0.0:1787579946.612639:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787579946.612648:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7f35df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874413262769536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787579946.612707:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7f35df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874413262769536:12345-0@lo:400:kworker.0 Request processed in 60us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579946.612723:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787579946.612740:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787579946.612745:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7f35c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874413262769152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787579946.612772:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7f35c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874413262769152:12345-0@lo:400:kworker.0 Request processed in 27us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579946.612777:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787579946.612799:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262769664 00000100:00100000:0.0:1787579946.612802:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262769664 00000100:00100000:0.0:1787579946.612832:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787579946.612838:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7f35ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874413262769664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787579946.612868:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7f35ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874413262769664:12345-0@lo:400:kworker.0 Request processed in 31us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579946.612874:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:0.0:1787579946.612889:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787579946.612894:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787579946.612951:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5f4af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874413262769152:0@lo:400:kworker.0 00010000:00080000:0.0:1787579946.612966:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae5ff1df80 x1874413262769664/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787579962 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787579946.612974:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5ff1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874413262769664:0@lo:400:kworker.0 00000100:00100000:0.0:1787579946.612983:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5f4ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874413262769536:0@lo:400:kworker.0 00000100:00100000:1.0:1787579946.613260:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5f4ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874413262769280:0@lo:400:kworker.0 00000100:00100000:1.0:1787579946.613292:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579946.613322:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787579946.613329:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5f4aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262769408:0@lo:400:kworker.0 00000100:00100000:1.0:1787579946.613352:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579946.613409:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262769408 00000100:00100000:1.0:1787579946.613413:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262769408 00000100:00100000:1.0:1787579946.613440:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787579946.613447:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5f811500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262769408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787579946.613494:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5f811500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262769408:12345-0@lo:400:kworker.0 Request processed in 47us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579946.613501:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1787579946.613528:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae5f4aca80 x1874413262769408/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787579962 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787579946.613539:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5f4aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262769408:0@lo:400:kworker.0 00000100:00100000:0.0:1787579946.613745:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262769280 00000100:00100000:0.0:1787579946.613749:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262769280 00000100:00100000:0.0:1787579946.613791:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787579946.613797:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5f813b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874413262769280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787579946.613841:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5f813b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874413262769280:12345-0@lo:400:kworker.0 Request processed in 43us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579946.613847:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:1.0:1787579946.614122:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787579946.614145:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5f4ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874413262769280:0@lo:400:kworker.0 00000100:00100000:2.0:1787579946.615709:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262769024 00000100:00100000:2.0:1787579946.615719:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262769024 00000100:00100000:2.0:1787579946.615795:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1787579946.615807:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+16:3314:x1874413262769024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787579946.615881:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+16:3314:x1874413262769024:12345-0@lo:400:kworker.0 Request processed in 77us (3680us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579946.615888:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1787579946.616204:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae77aab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3314:1874413262769024:0@lo:400:kworker.0 00000100:00100000:2.0:1787579947.127705:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d662300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262769792:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787579947.127813:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579947.129156:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262769792 00000100:00100000:0.0:1787579947.129184:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262769792 00000100:00100000:0.0:1787579947.129254:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787579947.129267:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5ff1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262769792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787579947.129315:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787579947.129420:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5ff1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262769792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 155us (1607us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579947.129429:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:2.0:1787579947.131851:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae6d662300 x1874413262769792/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787579963 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787579947.131880:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d662300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262769792:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787579947.271355:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787579947.271474:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239671040 00000100:00100000:3.0:1787579947.271485:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239671040 00000100:00100000:3.0:1787579947.271546:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 176 00000100:00100000:3.0:1787579947.271557:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ff68ada-0c43-4367-93b7-ad31684360cf+9:5603:x1874413239671040:12345-192.168.202.36@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787579947.271579:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787579947.271601:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fae4150fe00/0xc86deac20833776b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf454739e86a9cff6 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579947.271642:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fae4150fe00/0xc86deac20833776b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9cff6 expref: 10 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579947.271654:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fae4150fe00/0xc86deac20833776b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9cff6 expref: 10 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787579947.271664:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae4150fe00, rc 0) 00000100:00100000:3.0:1787579947.271725:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ff68ada-0c43-4367-93b7-ad31684360cf+10:5603:x1874413239671040:12345-192.168.202.36@tcp:101:ll_cfg_requeue.0 Request processed in 169us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579947.271732:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 176 00000100:00100000:2.0:1787579947.278086:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787579947.278131:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239671168 00000100:00100000:2.0:1787579947.278150:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239671168 00000100:00100000:2.0:1787579947.278198:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 177 00000100:00100000:2.0:1787579947.278217:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ff68ada-0c43-4367-93b7-ad31684360cf+10:5603:x1874413239671168:12345-192.168.202.36@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787579947.278510:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ff68ada-0c43-4367-93b7-ad31684360cf+10:5603:x1874413239671168:12345-192.168.202.36@tcp:501:ll_cfg_requeue.0 Request processed in 295us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579947.278519:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 177 00000100:00100000:1.0:1787579947.282275:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787579947.282991:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239671296 00000100:00100000:0.0:1787579947.283244:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239671296 00000100:00100000:0.0:1787579947.283305:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 178 00000100:00100000:0.0:1787579947.283316:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ff68ada-0c43-4367-93b7-ad31684360cf+10:5603:x1874413239671296:12345-192.168.202.36@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787579947.283626:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ff68ada-0c43-4367-93b7-ad31684360cf+10:5603:x1874413239671296:12345-192.168.202.36@tcp:503:ll_cfg_requeue.0 Request processed in 309us (1364us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579947.283635:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 178 00000100:00100000:1.0:1787579947.303027:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787579947.303196:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239671424 00000100:00100000:2.0:1787579947.303208:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239671424 00000100:00100000:2.0:1787579947.303260:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 179 00000100:00100000:2.0:1787579947.303271:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ff68ada-0c43-4367-93b7-ad31684360cf+10:6163:x1874413239671424:12345-192.168.202.36@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787579947.303570:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ff68ada-0c43-4367-93b7-ad31684360cf+10:6163:x1874413239671424:12345-192.168.202.36@tcp:502:llog_process_th.0 Request processed in 300us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579947.303577:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 179 00000100:00100000:2.0:1787579947.317350:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787579947.318220:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239671552 00000100:00100000:0.0:1787579947.318233:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239671552 00000100:00100000:0.0:1787579947.318293:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 180 00000100:00100000:0.0:1787579947.318305:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae487de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ff68ada-0c43-4367-93b7-ad31684360cf+10:6163:x1874413239671552:12345-192.168.202.36@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787579947.318592:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae487de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ff68ada-0c43-4367-93b7-ad31684360cf+10:6163:x1874413239671552:12345-192.168.202.36@tcp:502:llog_process_th.0 Request processed in 288us (1253us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579947.318601:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 180 00010000:00010000:2.0:1787579947.509034:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787579947.706040:0:5850:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787579947.706048:0:5850:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8fae77937800 from 4 10000000:01000000:0.0:1787579947.706053:0:5850:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787579947.706111:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae50fea000/0xc86deac208337772 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579947.706123:0:5850:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff8fae50fea000/0xc86deac208337772 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579947.706134:0:5850:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff8fae50fea000/0xc86deac208337772 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579947.706160:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7f35e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262769920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787579947.706230:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579947.706277:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae5dd21d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787579947.706301:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262769920 00000100:00100000:0.0:1787579947.706308:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262769920 00000100:00100000:0.0:1787579947.706359:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1787579947.706369:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae487df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+16:5850:x1874413262769920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787579947.706511:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787579947.706525:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fae50feb600/0xc86deac208337779 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc86deac208337772 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579947.706548:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fae50feb600/0xc86deac208337779 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc86deac208337772 expref: 17 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579947.706559:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fae50feb600/0xc86deac208337779 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac208337772 expref: 17 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579947.706568:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae50feb600, rc 0) 00000100:00100000:0.0:1787579947.706622:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae487df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+17:5850:x1874413262769920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 254us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579947.706629:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1787579947.706677:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7f35e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262769920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787579947.706692:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff8fae50fea000/0xc86deac208337772 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208337779 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579947.706700:0:5850:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff8fae50fea000/0xc86deac208337772 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc86deac208337779 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579947.706749:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7f35e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262770048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787579947.706773:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579947.706789:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae52109300 going to sleep for 11 seconds 00000100:00100000:0.0:1787579947.706801:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262770048 00000100:00100000:0.0:1787579947.706804:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262770048 00000100:00100000:0.0:1787579947.706825:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1787579947.706832:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae487dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+17:5850:x1874413262770048:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787579947.713466:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae487dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+17:5850:x1874413262770048:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 6625us (6682us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579947.713480:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1787579947.713560:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7f35e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262770048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787579947.713614:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7f35e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262770176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787579947.713660:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579947.713691:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae52109300 going to sleep for 11 seconds 00000100:00100000:0.0:1787579947.713707:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262770176 00000100:00100000:0.0:1787579947.713713:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262770176 00000100:00100000:0.0:1787579947.713755:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1787579947.713763:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae487ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+17:5850:x1874413262770176:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787579947.713969:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae487ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+17:5850:x1874413262770176:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 206us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579947.713977:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1787579947.714014:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7f35e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262770176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787579947.714252:0:8573:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7f35e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:8573:1874413262770304:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787579947.714287:0:8573:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579947.714305:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262770304 00000100:00100000:0.0:1787579947.714309:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262770304 00000100:00100000:0.0:1787579947.714327:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1787579947.714334:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae487df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+17:8573:x1874413262770304:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787579947.714515:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae487df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+17:8573:x1874413262770304:12345-0@lo:502:llog_process_th.0 Request processed in 181us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579947.714523:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1787579947.714573:0:8573:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae77a32cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787579947.714584:0:8573:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7f35e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:8573:1874413262770304:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787579947.714609:0:8573:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787579947.714618:0:8573:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787579947.714621:0:8573:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787579947.714634:0:8573:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8fae77937800 00000020:00000080:0.0:1787579947.714636:0:8573:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787579947.723122:0:8573:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5f810a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:8573:1874413262770432:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787579947.723218:0:8573:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579947.723269:0:8573:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fad43647d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787579947.724116:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262770432 00000100:00100000:0.0:1787579947.724127:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262770432 00000100:00100000:0.0:1787579947.724176:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1787579947.724186:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae487dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+17:8573:x1874413262770432:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787579947.724628:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae487dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+17:8573:x1874413262770432:12345-0@lo:502:llog_process_th.0 Request processed in 442us (1410us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579947.724637:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1787579947.725018:0:8573:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5f810a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:8573:1874413262770432:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787579947.725053:0:8573:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787579947.725073:0:8573:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787579947.725076:0:8573:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1787579947.725082:0:8573:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1787579947.725262:0:5850:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1787579947.725280:0:5850:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787579947.725291:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae50fea000/0xc86deac208337772 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208337779 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579947.725304:0:5850:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff8fae50fea000/0xc86deac208337772 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208337779 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787579947.725317:0:5850:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787579947.725320:0:5850:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8fae50613000 from 4 10000000:01000000:0.0:1787579947.725323:0:5850:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787579947.725353:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae50febc00/0xc86deac208337780 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579947.725361:0:5850:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff8fae50febc00/0xc86deac208337780 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579947.725371:0:5850:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff8fae50febc00/0xc86deac208337780 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579947.727028:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7f35e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262770560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787579947.727118:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579947.727167:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae77a32540 going to sleep for 11 seconds 00000100:00100000:0.0:1787579947.727191:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262770560 00000100:00100000:0.0:1787579947.727197:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262770560 00000100:00100000:0.0:1787579947.727242:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1787579947.727252:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae487dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+17:5850:x1874413262770560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787579947.727274:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787579947.727288:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fae50feae00/0xc86deac208337787 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc86deac208337780 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579947.727313:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fae50feae00/0xc86deac208337787 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc86deac208337780 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579947.727325:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fae50feae00/0xc86deac208337787 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac208337780 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579947.727333:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae50feae00, rc 0) 00000100:00100000:0.0:1787579947.727369:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae487dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+18:5850:x1874413262770560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579947.727376:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1787579947.729133:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7f35e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262770560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787579947.729167:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff8fae50febc00/0xc86deac208337780 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208337787 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579947.729179:0:5850:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff8fae50febc00/0xc86deac208337780 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc86deac208337787 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579947.729251:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7f35e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262770688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787579947.729298:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579947.729328:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae77a32540 going to sleep for 11 seconds 00000100:00100000:0.0:1787579947.729344:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262770688 00000100:00100000:0.0:1787579947.729350:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262770688 00000100:00100000:0.0:1787579947.731055:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1787579947.731093:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae487dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+18:5850:x1874413262770688:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787579947.732491:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae487dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+18:5850:x1874413262770688:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1401us (3185us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579947.732504:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1787579947.732574:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7f35e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262770688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787579947.732628:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7f35e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262770816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787579947.732678:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579947.732705:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae77a32540 going to sleep for 11 seconds 00000100:00100000:0.0:1787579947.732719:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262770816 00000100:00100000:0.0:1787579947.732724:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262770816 00000100:00100000:0.0:1787579947.732757:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1787579947.732764:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae487dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+18:5850:x1874413262770816:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787579947.736233:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae487dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+18:5850:x1874413262770816:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 3460us (3545us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579947.736250:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1787579947.736346:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7f35e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262770816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787579947.742237:0:8576:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7f35e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:8576:1874413262770944:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787579947.742328:0:8576:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579947.742365:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262770944 00000100:00100000:0.0:1787579947.742372:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262770944 00000100:00100000:0.0:1787579947.742458:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1787579947.742467:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae487dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+18:8576:x1874413262770944:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787579947.742685:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae487dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+18:8576:x1874413262770944:12345-0@lo:502:llog_process_th.0 Request processed in 218us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579947.742693:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1787579947.742752:0:8576:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae77a32000 going to sleep for 11 seconds 00000100:00100000:0.0:1787579947.742773:0:8576:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7f35e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:8576:1874413262770944:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787579947.742801:0:8576:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787579947.742812:0:8576:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787579947.742814:0:8576:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787579947.742822:0:8576:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8fae50613000 00000020:00000080:0.0:1787579947.742824:0:8576:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787579947.742903:0:8576:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7f35e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:8576:1874413262771072:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787579947.742938:0:8576:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579947.742957:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262771072 00000100:00100000:0.0:1787579947.742961:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262771072 00000100:00100000:0.0:1787579947.742982:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1787579947.742988:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae52127450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+18:8576:x1874413262771072:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787579947.743107:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae52127450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+18:8576:x1874413262771072:12345-0@lo:502:llog_process_th.0 Request processed in 118us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579947.743115:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1787579947.743146:0:8576:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae77a32000 going to sleep for 11 seconds 00000100:00100000:0.0:1787579947.743157:0:8576:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7f35e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:8576:1874413262771072:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787579947.743174:0:8576:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787579947.743178:0:8576:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787579947.743180:0:8576:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1787579947.743184:0:8576:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1787579947.743233:0:5850:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1787579947.743249:0:5850:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787579947.743259:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae50febc00/0xc86deac208337780 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208337787 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579947.743270:0:5850:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff8fae50febc00/0xc86deac208337780 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208337787 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787579947.743287:0:5850:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787579947.743289:0:5850:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8fae6a238800 from 4 10000000:01000000:0.0:1787579947.743292:0:5850:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787579947.743313:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae50feaa00/0xc86deac20833778e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579947.743321:0:5850:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff8fae50feaa00/0xc86deac20833778e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579947.743329:0:5850:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff8fae50feaa00/0xc86deac20833778e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579947.743343:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7f35e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262771200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787579947.743369:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579947.743411:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae77a32000 going to sleep for 11 seconds 00000100:00100000:0.0:1787579947.743424:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262771200 00000100:00100000:0.0:1787579947.743427:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262771200 00000100:00100000:0.0:1787579947.743446:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1787579947.743452:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae52126850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+18:5850:x1874413262771200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787579947.743460:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787579947.743474:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fae50feb200/0xc86deac208337795 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc86deac20833778e expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579947.743497:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fae50feb200/0xc86deac208337795 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc86deac20833778e expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579947.743507:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fae50feb200/0xc86deac208337795 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac20833778e expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579947.743525:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae50feb200, rc 0) 00000100:00100000:0.0:1787579947.743551:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae52126850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:5850:x1874413262771200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 98us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579947.743557:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1787579947.743586:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7f35e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262771200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787579947.743597:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff8fae50feaa00/0xc86deac20833778e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208337795 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579947.743605:0:5850:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff8fae50feaa00/0xc86deac20833778e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc86deac208337795 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787579947.743642:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7f35e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262771328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787579947.743665:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579947.743680:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae77a32000 going to sleep for 11 seconds 00000100:00100000:0.0:1787579947.743689:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262771328 00000100:00100000:0.0:1787579947.743692:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262771328 00000100:00100000:0.0:1787579947.743710:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1787579947.743717:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:5850:x1874413262771328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787579947.743921:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:5850:x1874413262771328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 205us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579947.743928:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1787579947.743956:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7f35e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262771328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787579947.743979:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7f35e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262771456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787579947.744008:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579947.744028:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae77a32000 going to sleep for 11 seconds 00000100:00100000:0.0:1787579947.744040:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262771456 00000100:00100000:0.0:1787579947.744043:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262771456 00000100:00100000:0.0:1787579947.744075:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1787579947.744082:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:5850:x1874413262771456:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787579947.744187:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:5850:x1874413262771456:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 105us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579947.744193:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1787579947.744229:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7f35e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262771456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787579947.770618:0:8577:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7f35e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:8577:1874413262771584:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787579947.770707:0:8577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579947.770748:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262771584 00000100:00100000:0.0:1787579947.770755:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262771584 00000100:00100000:0.0:1787579947.770796:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1787579947.770807:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:8577:x1874413262771584:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787579947.771115:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:8577:x1874413262771584:12345-0@lo:502:llog_process_th.0 Request processed in 309us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579947.771124:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1787579947.771185:0:8577:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae77a32000 going to sleep for 11 seconds 00000100:00100000:0.0:1787579947.771205:0:8577:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7f35e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:8577:1874413262771584:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787579947.771232:0:8577:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787579947.771241:0:8577:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787579947.771244:0:8577:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787579947.771250:0:8577:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8fae6a238800 00000020:00000080:0.0:1787579947.771252:0:8577:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787579947.771327:0:8577:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7f35e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:8577:1874413262771712:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787579947.771367:0:8577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579947.771758:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262771712 00000100:00100000:0.0:1787579947.771764:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262771712 00000100:00100000:0.0:1787579947.771794:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1787579947.771803:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:8577:x1874413262771712:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787579947.772657:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:8577:x1874413262771712:12345-0@lo:502:llog_process_th.0 Request processed in 853us (1286us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579947.772666:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1787579947.772727:0:8577:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae77a32000 going to sleep for 11 seconds 00000100:00100000:0.0:1787579947.772745:0:8577:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7f35e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:8577:1874413262771712:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787579947.772767:0:8577:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787579947.772773:0:8577:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787579947.772776:0:8577:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1787579947.772780:0:8577:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1787579947.772842:0:5850:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1787579947.772857:0:5850:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787579947.772868:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae50feaa00/0xc86deac20833778e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208337795 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579947.772880:0:5850:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff8fae50feaa00/0xc86deac20833778e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208337795 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787579947.979715:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787579947.979770:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787579947.979862:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787579947.979905:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787579947.979937:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239671808 00000100:00100000:1.0:1787579947.979960:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239671808 00000100:00100000:1.0:1787579947.980040:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 39 00000100:00100000:1.0:1787579947.980052:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5f810000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:2361:x1874413239671808:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:1.0:1787579947.980144:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5f810000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:2361:x1874413239671808:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 94us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579947.980152:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 39 00000100:00100000:1.0:1787579947.980177:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239671936 00000100:00100000:1.0:1787579947.980180:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239671936 00000100:00100000:1.0:1787579947.980206:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239672064 00000100:00100000:1.0:1787579947.980209:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239672064 00000100:00100000:1.0:1787579947.980225:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 21 00000100:00100000:1.0:1787579947.980232:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5f810a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+5:2361:x1874413239671936:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:1.0:1787579947.980258:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5f810a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+5:2361:x1874413239671936:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 26us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579947.980265:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 21 00000100:00100000:1.0:1787579947.980274:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 22 00000100:00100000:1.0:1787579947.980280:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5f811880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+5:2361:x1874413239672064:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:1.0:1787579947.980299:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5f811880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+5:2361:x1874413239672064:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 20us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579947.980305:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 22 00000100:00080000:1.0:1787579947.980320:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787579947.980324:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787579947.980327:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787579947.980564:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239671680 00000100:00100000:2.0:1787579947.980568:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239671680 00000100:00100000:2.0:1787579947.980604:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 196 00000100:00100000:2.0:1787579947.980611:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5ba0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ff68ada-0c43-4367-93b7-ad31684360cf+10:2361:x1874413239671680:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:2.0:1787579947.980644:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5ba0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ff68ada-0c43-4367-93b7-ad31684360cf+10:2361:x1874413239671680:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 34us (944us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579947.980650:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 196 00010000:00010000:3.0:1787579948.531732:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787579949.555561:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787579950.580364:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787579951.220900:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7f35e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874413262771840:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787579951.221004:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579951.221137:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262771840 00000100:00100000:0.0:1787579951.221147:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262771840 00000100:00100000:0.0:1787579951.221233:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787579951.221245:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5f810380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874413262771840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787579951.221325:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787579951.221410:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5f810380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874413262771840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 139us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579951.221419:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:0.0:1787579951.221471:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae7f35e680 x1874413262771840/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787579967 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787579951.221491:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7f35e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874413262771840:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787579951.221878:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787579951.603659:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787579951.734036:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d663800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3314:1874413262771968:0@lo:400:kworker.0 00000100:00100000:3.0:1787579951.734112:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579951.734162:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d661180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874413262772480:0@lo:400:kworker.0 00000100:00100000:3.0:1787579951.734189:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579951.734214:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787579951.734220:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d660e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874413262772096:0@lo:400:kworker.0 00000100:00100000:3.0:1787579951.734243:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579951.734261:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d662d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874413262772608:0@lo:400:kworker.0 00000100:00100000:3.0:1787579951.734307:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579951.734339:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d661500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874413262772224:0@lo:400:kworker.0 00000100:00100000:3.0:1787579951.734364:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579951.734506:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787579951.734514:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d661c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262772352:0@lo:400:kworker.0 00000100:00100000:3.0:1787579951.734539:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579951.734578:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262772480 00000100:00100000:3.0:1787579951.734585:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262772480 00000100:00100000:3.0:1787579951.734631:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262772096 00000100:00100000:3.0:1787579951.734634:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262772096 00000100:00100000:3.0:1787579951.734645:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262772224 00000100:00100000:3.0:1787579951.734648:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262772224 00000100:00100000:3.0:1787579951.734662:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787579951.734670:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d662300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874413262772480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787579951.734719:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d662300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874413262772480:12345-0@lo:400:kworker.0 Request processed in 50us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579951.734726:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787579951.734743:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787579951.734749:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d663480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874413262772096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787579951.734774:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d663480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874413262772096:12345-0@lo:400:kworker.0 Request processed in 26us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579951.734781:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787579951.734792:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787579951.734798:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fad43125f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874413262772224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787579951.734825:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fad43125f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874413262772224:12345-0@lo:400:kworker.0 Request processed in 29us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579951.734831:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787579951.734849:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262772608 00000100:00100000:3.0:1787579951.734852:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262772608 00000100:00100000:3.0:1787579951.734876:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262772352 00000100:00100000:3.0:1787579951.734879:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262772352 00000100:00100000:3.0:1787579951.734892:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787579951.734897:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fad43125c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874413262772608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787579951.734925:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fad43125c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874413262772608:12345-0@lo:400:kworker.0 Request processed in 27us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579951.734937:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787579951.734948:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787579951.734955:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fad43126a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262772352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787579951.734981:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fad43126a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262772352:12345-0@lo:400:kworker.0 Request processed in 28us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579951.734987:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1787579951.735008:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787579951.735012:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787579951.735162:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae6d661c00 x1874413262772352/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787579967 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787579951.735174:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d661c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262772352:0@lo:400:kworker.0 00000100:00100000:3.0:1787579951.735188:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d661500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874413262772224:0@lo:400:kworker.0 00000100:00100000:3.0:1787579951.735217:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d660e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874413262772096:0@lo:400:kworker.0 00010000:00080000:3.0:1787579951.735227:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae6d662d80 x1874413262772608/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787579967 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787579951.735238:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d662d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874413262772608:0@lo:400:kworker.0 00000100:00100000:3.0:1787579951.735249:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d661180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874413262772480:0@lo:400:kworker.0 00000100:00100000:0.0:1787579951.735633:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262771968 00000100:00100000:0.0:1787579951.735638:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262771968 00000100:00100000:0.0:1787579951.735782:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1787579951.735792:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5ba0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:3314:x1874413262771968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787579951.735848:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5ba0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:3314:x1874413262771968:12345-0@lo:400:kworker.0 Request processed in 58us (1737us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579951.735855:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1787579951.735903:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d663800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3314:1874413262771968:0@lo:400:kworker.0 00000100:00100000:2.0:1787579952.245802:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5ff1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262772736:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787579952.245891:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579952.245983:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262772736 00000100:00100000:2.0:1787579952.245991:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262772736 00000100:00100000:2.0:1787579952.246086:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787579952.246096:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5ff1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262772736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787579952.246135:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787579952.246178:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5ff1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262772736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579952.246186:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1787579952.246227:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae5ff1e300 x1874413262772736/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787579968 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787579952.246261:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5ff1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262772736:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787579952.627720:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787579952.800688:0:8816:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg236-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:1.0:1787579953.103519:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787579953.103566:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787579953.103647:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239672320 00000100:00100000:3.0:1787579953.103657:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239672320 00000100:00100000:3.0:1787579953.103733:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 43 00000100:00100000:3.0:1787579953.103755:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5f813480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:2360:x1874413239672320:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:3.0:1787579953.103847:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5f813480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:2360:x1874413239672320:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 87us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579953.103872:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 43 00000100:00080000:1.0:1787579953.104029:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787579953.104083:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239672192 00000100:00100000:0.0:1787579953.104088:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239672192 00000100:00100000:0.0:1787579953.104121:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 198 00000100:00100000:0.0:1787579953.104129:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5ba09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ff68ada-0c43-4367-93b7-ad31684360cf+10:2360:x1874413239672192:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:0.0:1787579953.104168:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5ba09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ff68ada-0c43-4367-93b7-ad31684360cf+10:2360:x1874413239672192:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 39us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579953.104175:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 198 00000100:00100000:1.0:1787579953.114493:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787579953.114904:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787579953.115322:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239672448 00000100:00100000:3.0:1787579953.115333:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239672448 00000100:00100000:3.0:1787579953.115471:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239672576 00000100:00100000:3.0:1787579953.115476:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239672576 00000100:00080000:0.0:1787579953.115528:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787579953.115532:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787579953.115590:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 10 00000100:00100000:1.0:1787579953.115603:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5f812a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+5:2357:x1874413239672448:12345-192.168.202.36@tcp:9:kworker.0 00000020:00000080:1.0:1787579953.115645:0:6707:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc86deac2083376d1 00000100:00080000:1.0:1787579953.115656:0:6707:0:(import.c:65:import_set_state_nolock()) ffff8fae5ff3b000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787579953.115701:0:6707:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:0.0:1787579953.115910:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787579953.116475:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5f812a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+2:2357:x1874413239672448:12345-192.168.202.36@tcp:9:kworker.0 Request processed in 874us (1990us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579953.116486:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 10 00000100:00100000:1.0:1787579953.116505:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 11 00000100:00100000:1.0:1787579953.116513:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5ff1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+5:2357:x1874413239672576:12345-192.168.202.36@tcp:9:kworker.0 00000020:00000080:1.0:1787579953.116529:0:6707:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc86deac2083376d8 00000100:00080000:1.0:1787579953.116536:0:6707:0:(import.c:65:import_set_state_nolock()) ffff8fae5ff3f000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787579953.116560:0:6707:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1787579953.116726:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5ff1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+2:2357:x1874413239672576:12345-192.168.202.36@tcp:9:kworker.0 Request processed in 214us (1823us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579953.117540:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 11 00010000:00010000:0.0:1787579953.117610:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579953.651622:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787579954.675564:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787579955.707597:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787579956.339767:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7f35e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874413262772864:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787579956.339840:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579956.340057:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262772864 00000100:00100000:0.0:1787579956.340066:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262772864 00000100:00100000:0.0:1787579956.340141:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787579956.340150:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5ff1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874413262772864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787579956.340185:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787579956.340233:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5ff1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874413262772864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579956.340241:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1787579956.340356:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787579956.340673:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae7f35e680 x1874413262772864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787579972 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787579956.340694:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7f35e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874413262772864:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787579956.731092:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787579956.852099:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7f35e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3314:1874413262772992:0@lo:400:kworker.0 00000100:00100000:0.0:1787579956.852108:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5f4ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874413262773248:0@lo:400:kworker.0 00000100:00100000:2.0:1787579956.852161:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7f35e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874413262773120:0@lo:400:kworker.0 00000100:00100000:1.0:1787579956.856429:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579956.856967:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5f4ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874413262773504:0@lo:400:kworker.0 00000100:00100000:1.0:1787579956.857041:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579956.857417:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262772992 00000100:00100000:3.0:1787579956.857428:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262772992 00000100:00100000:3.0:1787579956.857483:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1787579956.857494:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5ba09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:3314:x1874413262772992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787579956.857561:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5ba09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:3314:x1874413262772992:12345-0@lo:400:kworker.0 Request processed in 69us (1140us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579956.857569:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1787579956.857598:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7f35e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3314:1874413262772992:0@lo:400:kworker.0 00000100:00100000:3.0:1787579956.857599:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262773504 00000100:00100000:3.0:1787579956.857602:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262773504 00000100:00100000:3.0:1787579956.857645:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787579956.857652:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5f811f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874413262773504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787579956.857690:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5f811f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874413262773504:12345-0@lo:400:kworker.0 Request processed in 39us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579956.857696:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:3.0:1787579956.857712:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787579956.857766:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae5f4ac700 x1874413262773504/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787579972 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787579956.857778:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5f4ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874413262773504:0@lo:400:kworker.0 00000100:00100000:2.0:1787579956.863518:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579956.863601:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262773120 00000100:00100000:3.0:1787579956.863610:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262773120 00000100:00100000:2.0:1787579956.863611:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5f4aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1874413262773376:0@lo:400:kworker.0 00000100:00100000:2.0:1787579956.863645:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579956.863665:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262773376 00000100:00100000:3.0:1787579956.863669:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262773376 00000100:00100000:2.0:1787579956.863678:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787579956.863687:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5ff1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874413262773120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787579956.863707:0:5854:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1787579956.863715:0:5854:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00080000:3.0:1787579956.863729:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787579956.864331:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5ff1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874413262773120:12345-0@lo:400:kworker.0 Request processed in 642us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579956.864349:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787579956.864370:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787579956.864377:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5ff1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1874413262773376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787579956.864443:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5ff1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1874413262773376:12345-0@lo:400:kworker.0 Request processed in 67us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579956.864450:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787579956.864474:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7f35e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874413262773120:0@lo:400:kworker.0 00000100:00100000:0.0:1787579956.865034:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5f4aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1874413262773376:0@lo:400:kworker.0 00000100:00100000:1.0:1787579956.868474:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579956.868720:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262773248 00000100:00100000:0.0:1787579956.868740:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262773248 00000100:00100000:0.0:1787579956.868813:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787579956.868823:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5f811180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874413262773248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787579956.868888:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5f811180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874413262773248:12345-0@lo:400:kworker.0 Request processed in 67us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579956.868896:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787579956.868948:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5f4ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874413262773248:0@lo:400:kworker.0 00000100:00080000:1.0:1787579956.870288:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787579957.372985:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787579957.373012:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5f812680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874413262773632:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787579957.373088:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579957.373663:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262773632 00000100:00100000:0.0:1787579957.373673:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262773632 00000100:00100000:0.0:1787579957.373745:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787579957.373756:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5f812d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874413262773632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787579957.373794:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787579957.373857:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5f812d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874413262773632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (767us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579957.373877:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1787579957.373922:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae5f812680 x1874413262773632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787579973 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787579957.373952:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5f812680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874413262773632:0@lo:13:osp-pre-1-0.0 00000001:00100000:2.0:1787579957.534348:0:7653:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 31d1df27-21ab-4c76-bd19-e53fa778bd7e 00000020:00000080:2.0:1787579957.534357:0:7653:0:(genops.c:885:class_export_put()) final put ffff8fae5ff3a800/31d1df27-21ab-4c76-bd19-e53fa778bd7e 00000020:00000080:1.0:1787579957.534605:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8fae5ff3a800/31d1df27-21ab-4c76-bd19-e53fa778bd7e for lustre-OST0001 00000020:00000080:1.0:1787579957.534651:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8fae5ff3f000 for lustre-OST0001 00000001:00100000:1.0:1787579957.536719:0:6733:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 31d1df27-21ab-4c76-bd19-e53fa778bd7e 00000020:00000080:1.0:1787579957.536728:0:6733:0:(genops.c:885:class_export_put()) final put ffff8fae5ff39000/31d1df27-21ab-4c76-bd19-e53fa778bd7e 00000020:00000080:1.0:1787579957.536759:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8fae5ff39000/31d1df27-21ab-4c76-bd19-e53fa778bd7e for lustre-OST0000 00000020:00000080:1.0:1787579957.536795:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8fae5ff3b000 for lustre-OST0000 00010000:00010000:1.0:1787579957.748549:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787579958.214986:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787579958.215030:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787579958.215741:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239672832 00000100:00100000:0.0:1787579958.215753:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239672832 00000100:00100000:0.0:1787579958.215824:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 47 00000100:00100000:0.0:1787579958.215834:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fad43126300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:2361:x1874413239672832:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:0.0:1787579958.215929:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fad43126300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:2361:x1874413239672832:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 96us (897us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579958.215938:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 47 00000100:00080000:3.0:1787579958.215975:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787579958.216092:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239672704 00000100:00100000:1.0:1787579958.216097:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239672704 00000100:00100000:1.0:1787579958.216138:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 200 00000100:00100000:1.0:1787579958.216146:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5ba0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ff68ada-0c43-4367-93b7-ad31684360cf+10:2361:x1874413239672704:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:1.0:1787579958.216187:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5ba0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ff68ada-0c43-4367-93b7-ad31684360cf+10:2361:x1874413239672704:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 42us (1222us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579958.216193:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 200 00010000:00010000:0.0:1787579958.773756:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787579959.796814:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787579960.249250:0:9064:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg236-server.virtnet: executing yml_node 00010000:00010000:0.0:1787579960.823280:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787579961.461812:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787579961.461839:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5f4ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874413262773760:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787579961.461912:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579961.461991:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262773760 00000100:00100000:0.0:1787579961.462000:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262773760 00000100:00100000:0.0:1787579961.462061:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787579961.462071:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5f4aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874413262773760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787579961.462107:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787579961.462152:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5f4aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874413262773760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579961.462159:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1787579961.462192:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787579961.462223:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae5f4ac000 x1874413262773760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787579977 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787579961.462244:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5f4ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874413262773760:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787579961.844350:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787579961.972423:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5ff1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874413262774016:0@lo:400:kworker.0 00000100:00100000:0.0:1787579961.972516:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579961.972592:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787579961.972600:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5ff1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874413262774144:0@lo:400:kworker.0 00000100:00100000:0.0:1787579961.972627:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579961.972695:0:8897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262774016 00000100:00100000:0.0:1787579961.972706:0:8897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262774016 00000100:00100000:0.0:1787579961.972899:0:8897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262774144 00000100:00100000:0.0:1787579961.972903:0:8897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262774144 00000100:00100000:0.0:1787579961.972956:0:8897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787579961.972970:0:8897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5f4ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874413262774016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787579961.973043:0:8897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5f4ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874413262774016:12345-0@lo:400:kworker.0 Request processed in 76us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579961.973051:0:8897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787579961.973070:0:8897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787579961.973076:0:8897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5f4af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874413262774144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787579961.973105:0:8897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5f4af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874413262774144:12345-0@lo:400:kworker.0 Request processed in 29us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579961.973111:0:8897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:0.0:1787579961.973136:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787579961.973202:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5ff1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874413262774144:0@lo:400:kworker.0 00000100:00100000:0.0:1787579961.973213:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5ff1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874413262774016:0@lo:400:kworker.0 00000100:00100000:0.0:1787579961.973273:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5ff1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1874413262774272:0@lo:400:kworker.0 00000100:00100000:0.0:1787579961.973303:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579961.973322:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787579961.973328:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5ff1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3316:1874413262773888:0@lo:400:kworker.0 00000100:00100000:0.0:1787579961.973356:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579961.973410:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5ff1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262774400:0@lo:400:kworker.0 00000100:00100000:2.0:1787579961.973897:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262774272 00000100:00100000:2.0:1787579961.973906:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262774272 00000100:00100000:2.0:1787579961.973965:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787579961.973974:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5f4ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874413262774272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787579961.974015:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5f4ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874413262774272:12345-0@lo:400:kworker.0 Request processed in 43us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579961.974022:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:2.0:1787579961.974042:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787579961.974306:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579961.974355:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5ff1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1874413262774272:0@lo:400:kworker.0 00000100:00100000:0.0:1787579961.975208:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262773888 00000100:00100000:0.0:1787579961.975216:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262773888 00000100:00100000:0.0:1787579961.975575:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1787579961.975589:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5ba0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:3316:x1874413262773888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787579961.975674:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5ba0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:3316:x1874413262773888:12345-0@lo:400:kworker.0 Request processed in 90us (2316us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579961.975969:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262774400 00000100:00100000:2.0:1787579961.975974:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262774400 00000100:00100000:2.0:1787579961.976015:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787579961.976023:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7e97f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262774400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787579961.976058:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7e97f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262774400:12345-0@lo:400:kworker.0 Request processed in 37us (1752us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579961.976065:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:2.0:1787579961.976087:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787579961.976235:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1787579961.976365:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5ff1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3316:1874413262773888:0@lo:400:kworker.0 00010000:00080000:0.0:1787579961.976415:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae5ff1ca80 x1874413262774400/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787579977 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787579961.976541:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5ff1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262774400:0@lo:400:kworker.0 00000100:00100000:2.0:1787579962.489643:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5f813100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874413262774528:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787579962.490990:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579962.501504:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262774528 00000100:00100000:1.0:1787579962.501524:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262774528 00000100:00100000:1.0:1787579962.501634:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787579962.501648:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5ff1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874413262774528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787579962.501704:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787579962.501832:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5ff1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874413262774528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 187us (10847us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579962.501841:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1787579962.501927:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae5f813100 x1874413262774528/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787579978 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787579962.501967:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5f813100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874413262774528:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787579962.867561:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787579963.338745:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787579963.338819:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787579963.338965:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239673088 00000100:00100000:1.0:1787579963.338976:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239673088 00000100:00100000:1.0:1787579963.339064:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 51 00000100:00100000:1.0:1787579963.339077:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fad43124700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:2358:x1874413239673088:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:1.0:1787579963.339177:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fad43124700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:2358:x1874413239673088:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 103us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579963.339186:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 51 00000100:00080000:2.0:1787579963.339263:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787579963.339417:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239672960 00000100:00100000:0.0:1787579963.339422:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239672960 00000100:00100000:0.0:1787579963.339455:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 202 00000100:00100000:0.0:1787579963.339463:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5ba08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ff68ada-0c43-4367-93b7-ad31684360cf+10:2358:x1874413239672960:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:0.0:1787579963.339508:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5ba08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ff68ada-0c43-4367-93b7-ad31684360cf+10:2358:x1874413239672960:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 46us (775us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579963.339516:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 202 00010000:00010000:0.0:1787579963.891695:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787579964.928854:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787579965.113812:0:9256:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.80 00010000:00010000:2.0:1787579965.939759:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787579966.579636:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7e97d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874413262774656:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787579966.579743:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579966.579932:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262774656 00000100:00100000:0.0:1787579966.579941:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262774656 00000100:00100000:0.0:1787579966.580013:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787579966.580023:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fad43124e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874413262774656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787579966.580074:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787579966.580126:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fad43124e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874413262774656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579966.580135:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1787579966.580331:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787579966.580365:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae7e97d500 x1874413262774656/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787579982 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787579966.580408:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7e97d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874413262774656:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787579966.964995:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787579967.091998:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5f812680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874413262775040:0@lo:400:kworker.0 00000100:00100000:1.0:1787579967.092199:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579967.092260:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787579967.092267:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7f35e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874413262775168:0@lo:400:kworker.0 00000100:00100000:1.0:1787579967.092292:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579967.092326:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262775040 00000100:00100000:1.0:1787579967.092334:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262775040 00000100:00100000:1.0:1787579967.092412:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262775168 00000100:00100000:1.0:1787579967.092415:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262775168 00000100:00100000:1.0:1787579967.092442:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787579967.092452:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae77aab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874413262775040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787579967.092501:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae77aab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874413262775040:12345-0@lo:400:kworker.0 Request processed in 51us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579967.092508:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787579967.092525:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787579967.092531:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874413262775168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787579967.092572:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874413262775168:12345-0@lo:400:kworker.0 Request processed in 41us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579967.092577:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:1.0:1787579967.092593:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787579967.092626:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7f35e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874413262775168:0@lo:400:kworker.0 00000100:00100000:1.0:1787579967.092636:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5f812680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874413262775040:0@lo:400:kworker.0 00000100:00100000:0.0:1787579967.092949:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5f813800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3316:1874413262774784:0@lo:400:kworker.0 00000100:00100000:0.0:1787579967.092986:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579967.093013:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7f35e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262775296:0@lo:400:kworker.0 00000100:00100000:0.0:1787579967.093038:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579967.093071:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787579967.093077:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5f813100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874413262774912:0@lo:400:kworker.0 00000100:00100000:0.0:1787579967.093098:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579967.093125:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262774784 00000100:00100000:0.0:1787579967.093130:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262774784 00000100:00100000:0.0:1787579967.093158:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1787579967.093165:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5ba09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:3316:x1874413262774784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787579967.093198:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5ba09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:3316:x1874413262774784:12345-0@lo:400:kworker.0 Request processed in 34us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579967.093210:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1787579967.093238:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262775296 00000100:00100000:0.0:1787579967.093242:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262775296 00000100:00100000:0.0:1787579967.093274:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787579967.093281:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7e97fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262775296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787579967.093312:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7e97fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262775296:12345-0@lo:400:kworker.0 Request processed in 31us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579967.093318:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:0.0:1787579967.093339:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787579967.093356:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5f813800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3316:1874413262774784:0@lo:400:kworker.0 00010000:00080000:0.0:1787579967.093369:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae7f35e300 x1874413262775296/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787579983 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787579967.093378:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7f35e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262775296:0@lo:400:kworker.0 00000100:00100000:0.0:1787579967.093412:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262774912 00000100:00100000:0.0:1787579967.093415:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262774912 00000100:00100000:0.0:1787579967.093440:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787579967.093446:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7e97ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874413262774912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787579967.093479:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7e97ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874413262774912:12345-0@lo:400:kworker.0 Request processed in 33us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579967.093484:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787579967.093509:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5f813100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874413262774912:0@lo:400:kworker.0 00000100:00100000:1.0:1787579967.608160:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae48c93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874413262775424:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787579967.608236:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579967.608307:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262775424 00000100:00100000:1.0:1787579967.608315:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262775424 00000100:00100000:1.0:1787579967.608359:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787579967.608368:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874413262775424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787579967.608424:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787579967.608469:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874413262775424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579967.608476:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1787579967.608588:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae48c93b80 x1874413262775424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787579983 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787579967.608607:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae48c93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874413262775424:0@lo:13:osp-pre-1-0.0 00000001:02000400:3.0:1787579967.938058:0:9355:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.80 00010000:00010000:0.0:1787579967.988274:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787579968.453313:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787579968.453353:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787579968.453635:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239673216 00000100:00100000:1.0:1787579968.453646:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239673216 00000100:00100000:1.0:1787579968.453695:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 204 00000100:00100000:1.0:1787579968.453716:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5ba08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ff68ada-0c43-4367-93b7-ad31684360cf+10:2361:x1874413239673216:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:1.0:1787579968.453790:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5ba08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ff68ada-0c43-4367-93b7-ad31684360cf+10:2361:x1874413239673216:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 76us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579968.453926:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 204 00000100:00100000:1.0:1787579968.453963:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239673344 00000100:00100000:1.0:1787579968.453967:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239673344 00000100:00100000:1.0:1787579968.454006:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 55 00000100:00100000:1.0:1787579968.454013:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7e97f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:2361:x1874413239673344:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:1.0:1787579968.454044:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7e97f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:2361:x1874413239673344:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 32us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579968.454051:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 55 00000100:00080000:1.0:1787579968.454067:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787579969.014303:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579970.035852:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787579970.599080:0:9453:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.80 00010000:00010000:0.0:1787579971.059642:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787579971.699781:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787579971.699806:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7e97f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874413262775552:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787579971.699916:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579971.700146:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262775552 00000100:00100000:0.0:1787579971.700156:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262775552 00000100:00100000:0.0:1787579971.700230:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787579971.700241:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fad43124000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874413262775552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787579971.700281:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787579971.700330:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fad43124000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874413262775552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579971.700337:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1787579971.700408:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787579971.701304:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae7e97f100 x1874413262775552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787579987 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787579971.701327:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7e97f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874413262775552:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1787579971.888190:0:9501:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Mon Aug 24 09:59:30 EDT 2026 00010000:00010000:0.0:1787579972.087818:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787579972.211927:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5ff1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3315:1874413262775680:0@lo:400:kworker.0 00000100:00100000:3.0:1787579972.212014:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579972.212100:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5ff1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874413262776192:0@lo:400:kworker.0 00000100:00100000:3.0:1787579972.212140:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579972.212180:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787579972.212186:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5ff1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1874413262776064:0@lo:400:kworker.0 00000100:00100000:3.0:1787579972.212212:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579972.212243:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262776192 00000100:00100000:3.0:1787579972.212251:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262776192 00000100:00100000:3.0:1787579972.212310:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787579972.212320:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fad43125880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1874413262776192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787579972.212378:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fad43125880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1874413262776192:12345-0@lo:400:kworker.0 Request processed in 59us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579972.212412:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1787579972.212436:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787579972.212466:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae5ff1dc00 x1874413262776192/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787579988 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787579972.212481:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5ff1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874413262776192:0@lo:400:kworker.0 00000100:00100000:1.0:1787579972.212957:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5ff1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1874413262775936:0@lo:400:kworker.0 00000100:00100000:1.0:1787579972.212992:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579972.213030:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787579972.213036:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5ff1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874413262775808:0@lo:400:kworker.0 00000100:00100000:1.0:1787579972.213058:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579972.213086:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262776064 00000100:00100000:1.0:1787579972.213091:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262776064 00000100:00100000:1.0:1787579972.213124:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262775936 00000100:00100000:1.0:1787579972.213127:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262775936 00000100:00100000:1.0:1787579972.213141:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262775808 00000100:00100000:1.0:1787579972.213144:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262775808 00000100:00100000:1.0:1787579972.213157:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787579972.213174:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fad43124380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874413262776064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787579972.213214:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fad43124380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874413262776064:12345-0@lo:400:kworker.0 Request processed in 51us (1001us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579972.213220:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787579972.213244:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787579972.213251:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874413262775936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787579972.213284:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874413262775936:12345-0@lo:400:kworker.0 Request processed in 34us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579972.213290:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787579972.213300:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787579972.213306:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874413262775808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787579972.213330:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874413262775808:12345-0@lo:400:kworker.0 Request processed in 24us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579972.213336:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:1.0:1787579972.213355:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787579972.213375:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5ff1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874413262775808:0@lo:400:kworker.0 00000100:00100000:1.0:1787579972.213405:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5ff1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1874413262775936:0@lo:400:kworker.0 00000100:00100000:1.0:1787579972.213430:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5ff1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1874413262776064:0@lo:400:kworker.0 00000100:00100000:2.0:1787579972.213599:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262775680 00000100:00100000:2.0:1787579972.213605:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262775680 00000100:00100000:2.0:1787579972.213642:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1787579972.213650:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5ba08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:3315:x1874413262775680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787579972.213687:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5ba08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:3315:x1874413262775680:12345-0@lo:400:kworker.0 Request processed in 38us (1673us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579972.213693:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1787579972.215830:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5ff1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3315:1874413262775680:0@lo:400:kworker.0 00000100:00100000:1.0:1787579972.723675:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787579972.723699:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae48c93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874413262776320:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787579972.723789:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579972.724106:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262776320 00000100:00100000:0.0:1787579972.724117:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262776320 00000100:00100000:0.0:1787579972.724170:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787579972.724184:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5f813100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874413262776320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787579972.724223:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787579972.724288:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5f813100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874413262776320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579972.724298:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1787579972.724589:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae48c93100 x1874413262776320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787579988 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787579972.724610:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae48c93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874413262776320:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787579973.109453:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787579973.579519:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787579973.579568:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787579973.579598:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239673600 00000100:00100000:1.0:1787579973.579608:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239673600 00000100:00100000:1.0:1787579973.579675:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 59 00000100:00100000:1.0:1787579973.579686:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5f813800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:2358:x1874413239673600:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:1.0:1787579973.579778:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5f813800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:2358:x1874413239673600:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 94us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579973.579787:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 59 00000100:00080000:1.0:1787579973.579811:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787579973.579977:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239673472 00000100:00100000:2.0:1787579973.579982:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239673472 00000100:00100000:2.0:1787579973.580022:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 206 00000100:00100000:2.0:1787579973.580031:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5ba0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ff68ada-0c43-4367-93b7-ad31684360cf+10:2358:x1874413239673472:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:2.0:1787579973.580068:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5ba0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ff68ada-0c43-4367-93b7-ad31684360cf+10:2358:x1874413239673472:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 38us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579973.580074:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 206 00010000:00010000:2.0:1787579974.134071:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787579975.156208:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787579976.181507:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787579976.821938:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7e97d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874413262776448:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787579976.822038:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579976.822555:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262776448 00000100:00100000:0.0:1787579976.822574:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262776448 00000100:00100000:0.0:1787579976.822697:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787579976.822710:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5ff1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874413262776448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787579976.822782:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1787579976.822929:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787579976.823058:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5ff1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874413262776448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 350us (1020us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579976.823066:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:2.0:1787579976.823213:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae7e97d180 x1874413262776448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787579992 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787579976.823238:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7e97d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874413262776448:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787579977.207620:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787579977.332935:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5ff1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3314:1874413262776576:0@lo:400:kworker.0 00000100:00100000:2.0:1787579977.333010:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579977.333055:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5ff1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874413262777088:0@lo:400:kworker.0 00000100:00100000:2.0:1787579977.333080:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579977.333107:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787579977.333112:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5ff1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874413262776704:0@lo:400:kworker.0 00000100:00100000:2.0:1787579977.333134:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579977.333151:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5ff1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874413262777216:0@lo:400:kworker.0 00000100:00100000:2.0:1787579977.333172:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579977.333199:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5ff1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874413262776832:0@lo:400:kworker.0 00000100:00100000:2.0:1787579977.333220:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579977.333238:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787579977.333243:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5ff1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262776960:0@lo:400:kworker.0 00000100:00100000:2.0:1787579977.333280:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579977.333564:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262776576 00000100:00100000:2.0:1787579977.333572:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262776576 00000100:00100000:2.0:1787579977.333617:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1787579977.333627:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5ba09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:3314:x1874413262776576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787579977.333690:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5ba09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:3314:x1874413262776576:12345-0@lo:400:kworker.0 Request processed in 64us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579977.333698:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1787579977.333739:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262777088 00000100:00100000:2.0:1787579977.333744:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262777088 00000100:00100000:2.0:1787579977.333776:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262776704 00000100:00100000:2.0:1787579977.333779:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262776704 00000100:00100000:2.0:1787579977.333790:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262776832 00000100:00100000:2.0:1787579977.333793:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262776832 00000100:00100000:2.0:1787579977.333821:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787579977.333828:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5ff1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874413262777088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787579977.333862:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5ff1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874413262777088:12345-0@lo:400:kworker.0 Request processed in 34us (781us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579977.333868:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787579977.333880:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787579977.333885:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5ff1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874413262776704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787579977.333909:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5ff1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874413262776704:12345-0@lo:400:kworker.0 Request processed in 25us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579977.333916:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787579977.333927:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787579977.333933:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5ff1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874413262776832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787579977.333960:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5ff1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874413262776832:12345-0@lo:400:kworker.0 Request processed in 28us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579977.333966:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787579977.333987:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262777216 00000100:00100000:2.0:1787579977.333990:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262777216 00000100:00100000:2.0:1787579977.334015:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262776960 00000100:00100000:2.0:1787579977.334018:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262776960 00000100:00100000:2.0:1787579977.334031:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787579977.334036:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5ff1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874413262777216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787579977.334064:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5ff1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874413262777216:12345-0@lo:400:kworker.0 Request processed in 28us (892us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579977.334077:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787579977.334090:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787579977.334096:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae77a8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262776960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787579977.334125:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae77a8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262776960:12345-0@lo:400:kworker.0 Request processed in 30us (846us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579977.334131:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787579977.334361:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5ff1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874413262776704:0@lo:400:kworker.0 00010000:00080000:2.0:1787579977.334375:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae5ff1c380 x1874413262777216/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787579993 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787579977.334409:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5ff1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874413262777216:0@lo:400:kworker.0 00000100:00100000:2.0:1787579977.334419:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5ff1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3314:1874413262776576:0@lo:400:kworker.0 00000100:00100000:2.0:1787579977.334428:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5ff1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874413262777088:0@lo:400:kworker.0 00000100:00080000:2.0:1787579977.334457:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787579977.334461:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787579977.334480:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae5ff1dc00 x1874413262776960/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787579993 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787579977.334489:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5ff1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262776960:0@lo:400:kworker.0 00000100:00100000:2.0:1787579977.334498:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5ff1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874413262776832:0@lo:400:kworker.0 00000100:00100000:0.0:1787579977.844021:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787579977.844045:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7e97ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874413262777344:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787579977.844113:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579977.844182:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262777344 00000100:00100000:0.0:1787579977.844190:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262777344 00000100:00100000:0.0:1787579977.844235:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787579977.844245:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7e97e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874413262777344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787579977.844278:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787579977.844318:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7e97e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874413262777344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579977.844325:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1787579977.844361:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae7e97ed80 x1874413262777344/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787579993 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787579977.844375:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7e97ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874413262777344:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787579978.230116:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787579978.702743:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787579978.702798:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787579978.702872:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239673856 00000100:00100000:3.0:1787579978.702884:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239673856 00000100:00100000:3.0:1787579978.702942:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 63 00000100:00100000:3.0:1787579978.702952:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5f812680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:2359:x1874413239673856:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:3.0:1787579978.703013:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5f812680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:2359:x1874413239673856:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 64us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579978.703018:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 63 00000100:00100000:2.0:1787579978.703098:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239673728 00000100:00100000:2.0:1787579978.703105:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239673728 00000100:00080000:1.0:1787579978.703142:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787579978.703147:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 208 00000100:00100000:2.0:1787579978.703156:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5ba08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ff68ada-0c43-4367-93b7-ad31684360cf+10:2358:x1874413239673728:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:2.0:1787579978.703216:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5ba08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ff68ada-0c43-4367-93b7-ad31684360cf+10:2358:x1874413239673728:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 61us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579978.703224:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 208 00010000:00010000:1.0:1787579979.255690:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787579980.275830:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579981.317829:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787579981.953334:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7e97ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874413262777472:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787579981.953439:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579981.955287:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262777472 00000100:00100000:0.0:1787579981.955305:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262777472 00000100:00100000:0.0:1787579981.955417:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787579981.955428:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae77a88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874413262777472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787579981.955469:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787579981.955550:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae77a88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874413262777472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 124us (2111us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579981.955558:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1787579981.955633:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae7e97ed80 x1874413262777472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787579997 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787579981.955665:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7e97ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874413262777472:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787579981.955960:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787579982.323608:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787579982.452114:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fad43127480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3314:1874413262777600:0@lo:400:kworker.0 00000100:00100000:3.0:1787579982.452192:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579982.452240:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fad43127800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874413262778112:0@lo:400:kworker.0 00000100:00100000:3.0:1787579982.452267:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579982.452292:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787579982.452298:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fad43125500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874413262777728:0@lo:400:kworker.0 00000100:00100000:3.0:1787579982.452316:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579982.452332:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fad43127100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874413262778240:0@lo:400:kworker.0 00000100:00100000:3.0:1787579982.452368:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579982.452428:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fad43127b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874413262777856:0@lo:400:kworker.0 00000100:00100000:3.0:1787579982.452453:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579982.452469:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787579982.452474:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fad43124a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262777984:0@lo:400:kworker.0 00000100:00100000:3.0:1787579982.452493:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579982.452524:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262777600 00000100:00100000:3.0:1787579982.452531:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262777600 00000100:00100000:3.0:1787579982.452641:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1787579982.452653:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5ba0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:3314:x1874413262777600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787579982.452781:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5ba0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:3314:x1874413262777600:12345-0@lo:400:kworker.0 Request processed in 129us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579982.452788:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1787579982.452823:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262778112 00000100:00100000:3.0:1787579982.452827:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262778112 00000100:00100000:3.0:1787579982.452859:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262777728 00000100:00100000:3.0:1787579982.452863:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262777728 00000100:00100000:3.0:1787579982.452874:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262777856 00000100:00100000:3.0:1787579982.452877:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262777856 00000100:00100000:3.0:1787579982.452908:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787579982.452914:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fad43125180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874413262778112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787579982.453183:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fad43125180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874413262778112:12345-0@lo:400:kworker.0 Request processed in 268us (914us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579982.453190:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787579982.453204:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787579982.453210:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fad43126d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874413262777728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787579982.453239:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fad43126d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874413262777728:12345-0@lo:400:kworker.0 Request processed in 29us (921us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579982.453245:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787579982.453256:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787579982.453262:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d663800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874413262777856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787579982.453467:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d663800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874413262777856:12345-0@lo:400:kworker.0 Request processed in 205us (1012us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579982.453474:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787579982.453496:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262778240 00000100:00100000:3.0:1787579982.453500:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262778240 00000100:00100000:3.0:1787579982.453535:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262777984 00000100:00100000:3.0:1787579982.453538:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262777984 00000100:00100000:3.0:1787579982.453552:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787579982.453557:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fad43126680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874413262778240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787579982.453653:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fad43126680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874413262778240:12345-0@lo:400:kworker.0 Request processed in 95us (1284us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579982.453660:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787579982.453671:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787579982.453678:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d661180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262777984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787579982.459092:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d661180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262777984:12345-0@lo:400:kworker.0 Request processed in 5404us (6586us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579982.459108:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1787579982.459157:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787579982.459163:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787579982.459208:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fad43125500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874413262777728:0@lo:400:kworker.0 00010000:00080000:3.0:1787579982.459225:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fad43127100 x1874413262778240/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787579998 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787579982.459236:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fad43127100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874413262778240:0@lo:400:kworker.0 00000100:00100000:3.0:1787579982.459248:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fad43127480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3314:1874413262777600:0@lo:400:kworker.0 00000100:00100000:3.0:1787579982.459259:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fad43127800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874413262778112:0@lo:400:kworker.0 00000100:00100000:0.0:1787579982.468774:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fad43127b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874413262777856:0@lo:400:kworker.0 00010000:00080000:1.0:1787579982.469553:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fad43124a80 x1874413262777984/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787579998 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787579982.469566:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fad43124a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262777984:0@lo:400:kworker.0 00000100:00100000:1.0:1787579982.964103:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7f35e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262778368:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787579982.964174:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579982.965021:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262778368 00000100:00100000:0.0:1787579982.965033:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262778368 00000100:00100000:0.0:1787579982.965084:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787579982.965094:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7f35e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262778368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787579982.965131:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787579982.965185:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7f35e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262778368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (1010us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579982.965192:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1787579982.965575:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae7f35e300 x1874413262778368/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787579998 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787579982.965596:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7f35e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262778368:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787579983.347778:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787579983.819447:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787579983.819680:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787579983.819845:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239673984 00000100:00100000:2.0:1787579983.819855:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239673984 00000100:00100000:2.0:1787579983.819916:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 210 00000100:00100000:2.0:1787579983.819927:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5ba0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ff68ada-0c43-4367-93b7-ad31684360cf+10:2361:x1874413239673984:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:2.0:1787579983.819992:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5ba0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ff68ada-0c43-4367-93b7-ad31684360cf+10:2361:x1874413239673984:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 67us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579983.820000:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 210 00000100:00100000:3.0:1787579983.824026:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239674112 00000100:00100000:3.0:1787579983.824040:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239674112 00000100:00100000:1.0:1787579983.824350:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 67 00000100:00100000:1.0:1787579983.824442:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7f35e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:2361:x1874413239674112:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:1.0:1787579983.824523:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7f35e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:2361:x1874413239674112:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 163us (4843us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579983.824531:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 67 00000100:00080000:0.0:1787579983.825157:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787579984.371527:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787579985.399942:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579986.424653:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787579987.060086:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787579987.060107:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7e97ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262778496:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787579987.060173:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579987.060242:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262778496 00000100:00100000:0.0:1787579987.060249:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262778496 00000100:00100000:0.0:1787579987.060299:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787579987.060308:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7e97dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262778496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787579987.060346:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787579987.060409:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7e97dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262778496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579987.060416:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:0.0:1787579987.060435:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787579987.060487:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae7e97ed80 x1874413262778496/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787580003 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787579987.060506:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7e97ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262778496:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787579987.444819:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787579987.575042:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae45278380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874413262778752:0@lo:400:kworker.0 00000100:00100000:1.0:1787579987.575121:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579987.575196:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae45278a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874413262779264:0@lo:400:kworker.0 00000100:00100000:1.0:1787579987.575223:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579987.575255:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787579987.575261:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae45279880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3315:1874413262778624:0@lo:400:kworker.0 00000100:00100000:1.0:1787579987.575286:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579987.575305:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae4527bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1874413262779136:0@lo:400:kworker.0 00000100:00100000:1.0:1787579987.575324:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579987.575349:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae45279500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874413262779008:0@lo:400:kworker.0 00000100:00100000:1.0:1787579987.575369:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579987.575402:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787579987.575408:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae4527b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1874413262778880:0@lo:400:kworker.0 00000100:00100000:1.0:1787579987.575429:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579987.575456:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262778752 00000100:00100000:1.0:1787579987.575463:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262778752 00000100:00100000:1.0:1787579987.575502:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262779136 00000100:00100000:1.0:1787579987.575505:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262779136 00000100:00100000:1.0:1787579987.575524:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262778880 00000100:00100000:1.0:1787579987.575527:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262778880 00000100:00100000:1.0:1787579987.575543:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787579987.575553:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae4527b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874413262778752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787579987.575602:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae4527b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874413262778752:12345-0@lo:400:kworker.0 Request processed in 50us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579987.575608:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787579987.575626:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787579987.575631:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae45279180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874413262779136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787579987.575665:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae45279180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874413262779136:12345-0@lo:400:kworker.0 Request processed in 33us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579987.575671:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787579987.575685:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787579987.575691:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae4527a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874413262778880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787579987.575736:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae4527a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874413262778880:12345-0@lo:400:kworker.0 Request processed in 44us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579987.575742:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:0.0:1787579987.576941:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787579987.577010:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262779264 00000100:00100000:0.0:1787579987.577017:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262779264 00000100:00100000:0.0:1787579987.577070:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262779008 00000100:00100000:0.0:1787579987.577074:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262779008 00000100:00100000:0.0:1787579987.577094:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787579987.577101:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae4527b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1874413262779264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787579987.577161:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae4527b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1874413262779264:12345-0@lo:400:kworker.0 Request processed in 61us (1937us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579987.577181:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787579987.577196:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787579987.577202:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae4527ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1874413262779008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787579987.577234:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae4527ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1874413262779008:12345-0@lo:400:kworker.0 Request processed in 32us (1863us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579987.577240:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787579987.577264:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262778624 00000100:00100000:0.0:1787579987.577268:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262778624 00000100:00100000:0.0:1787579987.577293:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1787579987.577299:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5ba0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:3315:x1874413262778624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787579987.577330:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5ba0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:3315:x1874413262778624:12345-0@lo:400:kworker.0 Request processed in 31us (2043us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579987.577336:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00080000:0.0:1787579987.577376:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787579987.577457:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae45279880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3315:1874413262778624:0@lo:400:kworker.0 00000100:00100000:0.0:1787579987.577485:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae4527bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1874413262779136:0@lo:400:kworker.0 00000100:00100000:0.0:1787579987.577497:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae45278380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874413262778752:0@lo:400:kworker.0 00010000:00080000:0.0:1787579987.577511:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae45278a80 x1874413262779264/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787580003 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787579987.577523:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae45278a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874413262779264:0@lo:400:kworker.0 00000100:00100000:0.0:1787579987.577573:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae4527b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1874413262778880:0@lo:400:kworker.0 00010000:00080000:0.0:1787579987.577584:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae45279500 x1874413262779008/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787580003 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787579987.577594:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae45279500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874413262779008:0@lo:400:kworker.0 00000001:02000400:1.0:1787579987.996154:0:10131:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 09:59:45 (1787579985) === 00000100:00100000:0.0:1787579988.091675:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae45279c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262779392:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787579988.091759:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579988.091884:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262779392 00000100:00100000:2.0:1787579988.091893:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262779392 00000100:00100000:2.0:1787579988.091950:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787579988.091960:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7e97ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262779392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787579988.091995:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787579988.092039:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7e97ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262779392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579988.092046:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1787579988.092206:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae45279c00 x1874413262779392/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787580004 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787579988.092225:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae45279c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262779392:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787579988.354908:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787579988.359216:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239674240 00000100:00100000:3.0:1787579988.359759:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239674240 00000100:00100000:2.0:1787579988.363654:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 212 00000100:00100000:2.0:1787579988.363691:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ff68ada-0c43-4367-93b7-ad31684360cf+10:8166:x1874413239674240:12345-192.168.202.36@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787579988.363721:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787579988.363745:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fae74ed9800/0xc86deac20833779c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xf454739e86a9cffd expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579988.363777:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fae74ed9800/0xc86deac20833779c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9cffd expref: 11 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579988.363787:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fae74ed9800/0xc86deac20833779c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9cffd expref: 11 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787579988.363797:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae74ed9800, rc 0) 00000100:00100000:2.0:1787579988.363891:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ff68ada-0c43-4367-93b7-ad31684360cf+11:8166:x1874413239674240:12345-192.168.202.36@tcp:101:mount.lustre.0 Request processed in 204us (8996us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579988.363899:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 212 00000100:00100000:2.0:1787579988.367882:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787579988.367984:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239674368 00000100:00100000:0.0:1787579988.367995:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239674368 00000100:00100000:0.0:1787579988.368059:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 213 00000100:00100000:0.0:1787579988.368069:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ff68ada-0c43-4367-93b7-ad31684360cf+11:8166:x1874413239674368:12345-192.168.202.36@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787579988.371210:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ff68ada-0c43-4367-93b7-ad31684360cf+11:8166:x1874413239674368:12345-192.168.202.36@tcp:501:mount.lustre.0 Request processed in 3127us (3323us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579988.371228:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 213 00000100:00100000:3.0:1787579988.381282:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787579988.381759:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239674496 00000100:00100000:0.0:1787579988.381790:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239674496 00000100:00100000:0.0:1787579988.381850:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 214 00000100:00100000:0.0:1787579988.381860:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ff68ada-0c43-4367-93b7-ad31684360cf+11:8166:x1874413239674496:12345-192.168.202.36@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787579988.382116:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ff68ada-0c43-4367-93b7-ad31684360cf+11:8166:x1874413239674496:12345-192.168.202.36@tcp:503:mount.lustre.0 Request processed in 256us (845us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579988.382125:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 214 00000100:00100000:1.0:1787579988.389945:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787579988.390138:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239674624 00000100:00100000:0.0:1787579988.390150:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239674624 00000100:00100000:0.0:1787579988.390773:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 215 00000100:00100000:0.0:1787579988.390787:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ff68ada-0c43-4367-93b7-ad31684360cf+11:8170:x1874413239674624:12345-192.168.202.36@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787579988.391120:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ff68ada-0c43-4367-93b7-ad31684360cf+11:8170:x1874413239674624:12345-192.168.202.36@tcp:502:llog_process_th.0 Request processed in 335us (1188us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579988.391130:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 215 00000100:00100000:1.0:1787579988.411359:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787579988.411556:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239674752 00000100:00100000:2.0:1787579988.411569:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239674752 00000100:00100000:2.0:1787579988.411638:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 216 00000100:00100000:2.0:1787579988.411649:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ff68ada-0c43-4367-93b7-ad31684360cf+11:8170:x1874413239674752:12345-192.168.202.36@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787579988.411966:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ff68ada-0c43-4367-93b7-ad31684360cf+11:8170:x1874413239674752:12345-192.168.202.36@tcp:502:llog_process_th.0 Request processed in 318us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579988.411976:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 216 00000100:00100000:2.0:1787579988.417103:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787579988.417206:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239674880 00000100:00100000:0.0:1787579988.417215:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239674880 00000100:00100000:0.0:1787579988.417289:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 217 00000100:00100000:0.0:1787579988.417309:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ff68ada-0c43-4367-93b7-ad31684360cf+11:8166:x1874413239674880:12345-192.168.202.36@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787579988.417334:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787579988.417353:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fae50feb400/0xc86deac2083377a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d027 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579988.417426:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fae50feb400/0xc86deac2083377a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d027 expref: 12 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579988.417439:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fae50feb400/0xc86deac2083377a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d027 expref: 12 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787579988.417470:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae50feb400, rc 0) 00000100:00100000:0.0:1787579988.417532:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ff68ada-0c43-4367-93b7-ad31684360cf+12:8166:x1874413239674880:12345-192.168.202.36@tcp:101:mount.lustre.0 Request processed in 220us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579988.417540:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 217 00000100:00100000:1.0:1787579988.420106:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787579988.420221:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239675008 00000100:00100000:3.0:1787579988.420241:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239675008 00000100:00100000:3.0:1787579988.420288:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 218 00000100:00100000:3.0:1787579988.420302:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ff68ada-0c43-4367-93b7-ad31684360cf+12:8166:x1874413239675008:12345-192.168.202.36@tcp:256:mount.lustre.0 20000000:01000000:3.0:1787579988.420507:0:5848:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1787579988.420538:0:5848:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787579988.420543:0:5848:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1787579988.420546:0:5848:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1787579988.420548:0:5848:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1787579988.422468:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ff68ada-0c43-4367-93b7-ad31684360cf+12:8166:x1874413239675008:12345-192.168.202.36@tcp:256:mount.lustre.0 Request processed in 2162us (2359us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579988.422482:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 218 00000100:00100000:2.0:1787579988.428272:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787579988.428965:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239675136 00000100:00100000:1.0:1787579988.428978:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239675136 00000100:00100000:1.0:1787579988.429122:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 219 00000100:00100000:1.0:1787579988.429133:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ff68ada-0c43-4367-93b7-ad31684360cf+12:8166:x1874413239675136:12345-192.168.202.36@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787579988.429151:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787579988.429168:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fae4ca59e00/0xc86deac2083377aa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d02e expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579988.429199:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fae4ca59e00/0xc86deac2083377aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d02e expref: 13 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579988.429211:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fae4ca59e00/0xc86deac2083377aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d02e expref: 13 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787579988.429237:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae4ca59e00, rc 0) 00000100:00100000:1.0:1787579988.429299:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ff68ada-0c43-4367-93b7-ad31684360cf+13:8166:x1874413239675136:12345-192.168.202.36@tcp:101:mount.lustre.0 Request processed in 168us (1037us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579988.429307:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 219 00000100:00100000:2.0:1787579988.437678:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787579988.437881:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239675264 00000100:00100000:0.0:1787579988.437891:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239675264 00000100:00100000:3.0:1787579988.437953:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 220 00000100:00100000:3.0:1787579988.437966:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ff68ada-0c43-4367-93b7-ad31684360cf+13:8166:x1874413239675264:12345-192.168.202.36@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787579988.438239:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ff68ada-0c43-4367-93b7-ad31684360cf+13:8166:x1874413239675264:12345-192.168.202.36@tcp:501:mount.lustre.0 Request processed in 276us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579988.438245:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 220 00000100:00100000:2.0:1787579988.442843:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787579988.443110:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239675392 00000100:00100000:3.0:1787579988.443120:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239675392 00000100:00100000:3.0:1787579988.443180:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 221 00000100:00100000:3.0:1787579988.443191:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ff68ada-0c43-4367-93b7-ad31684360cf+13:8166:x1874413239675392:12345-192.168.202.36@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787579988.443481:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ff68ada-0c43-4367-93b7-ad31684360cf+13:8166:x1874413239675392:12345-192.168.202.36@tcp:503:mount.lustre.0 Request processed in 291us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579988.443490:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 221 00000100:00100000:2.0:1787579988.448366:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787579988.448686:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239675520 00000100:00100000:1.0:1787579988.448710:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239675520 00000100:00100000:1.0:1787579988.448770:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 222 00000100:00100000:1.0:1787579988.448780:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ff68ada-0c43-4367-93b7-ad31684360cf+13:8174:x1874413239675520:12345-192.168.202.36@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787579988.449024:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ff68ada-0c43-4367-93b7-ad31684360cf+13:8174:x1874413239675520:12345-192.168.202.36@tcp:502:llog_process_th.0 Request processed in 244us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579988.449033:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 222 00000100:00100000:1.0:1787579988.453949:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787579988.455050:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239675648 00000100:00100000:0.0:1787579988.455063:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239675648 00000100:00100000:0.0:1787579988.455161:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 223 00000100:00100000:0.0:1787579988.455172:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ff68ada-0c43-4367-93b7-ad31684360cf+13:8174:x1874413239675648:12345-192.168.202.36@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787579988.455449:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ff68ada-0c43-4367-93b7-ad31684360cf+13:8174:x1874413239675648:12345-192.168.202.36@tcp:502:llog_process_th.0 Request processed in 278us (1509us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579988.455458:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 223 00000100:00100000:2.0:1787579988.466463:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787579988.466566:0:8897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239675776 00000100:00100000:0.0:1787579988.466577:0:8897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239675776 00000100:00100000:0.0:1787579988.466633:0:8897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 10 00000100:00100000:0.0:1787579988.466642:0:8897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae77a8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2357:x1874413239675776:12345-192.168.202.36@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787579988.466675:0:8897:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 8d66e8ae-0b45-4a46-9f01-8e93d52be8ea@192.168.202.36@tcp t0 exp 0000000000000000 cur 336 last 0 00000020:00000080:0.0:1787579988.466733:0:8897:0:(genops.c:1385:class_connect()) connect: client 8d66e8ae-0b45-4a46-9f01-8e93d52be8ea, cookie 0xc86deac2083377b1 00000004:00100000:0.0:1787579988.466774:0:8897:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1787579988.467040:0:8897:0:(import.c:65:import_set_state_nolock()) ffff8fae5ff39800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787579988.467162:0:8897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae77a8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8d66e8ae-0b45-4a46-9f01-8e93d52be8ea+6:2357:x1874413239675776:12345-192.168.202.36@tcp:38:mount.lustre.0 Request processed in 518us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579988.467170:0:8897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 10 00010000:00010000:0.0:1787579988.468217:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787579988.470203:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787579988.470316:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239676160 00000100:00100000:0.0:1787579988.470326:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239676160 00000100:00100000:0.0:1787579988.470432:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 71 00000100:00100000:0.0:1787579988.470445:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae77a8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:2361:x1874413239676160:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:0.0:1787579988.470525:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae77a8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:2361:x1874413239676160:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 83us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579988.470533:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 71 00000100:00080000:2.0:1787579988.470812:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787579988.482919:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787579988.483089:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787579988.483209:0:8897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239676032 00000100:00100000:1.0:1787579988.483221:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239675904 00000100:00100000:0.0:1787579988.483229:0:8897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239676032 00000100:00100000:1.0:1787579988.483305:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239675904 00000100:00100000:0.0:1787579988.483310:0:8897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 11 00000100:00100000:0.0:1787579988.483320:0:8897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae77a89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8d66e8ae-0b45-4a46-9f01-8e93d52be8ea+7:8166:x1874413239676032:12345-192.168.202.36@tcp:41:mount.lustre.0 00000100:00100000:1.0:1787579988.483351:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 12 00000100:00100000:1.0:1787579988.483362:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae77a8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d66e8ae-0b45-4a46-9f01-8e93d52be8ea+7:0:x1874413239675904:12345-192.168.202.36@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787579988.483363:0:8897:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000004:00000024:1.0:1787579988.483412:0:5854:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00080000:2.0:1787579988.483482:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787579988.483529:0:8897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae77a89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8d66e8ae-0b45-4a46-9f01-8e93d52be8ea+7:8166:x1874413239676032:12345-192.168.202.36@tcp:41:mount.lustre.0 Request processed in 211us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579988.483537:0:8897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 11 00000100:00100000:1.0:1787579988.485780:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae77a8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d66e8ae-0b45-4a46-9f01-8e93d52be8ea+6:0:x1874413239675904:12345-192.168.202.36@tcp:41:mount.lustre.0 Request processed in 2406us (2675us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579988.485794:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 12 00000100:00100000:3.0:1787579988.485895:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787579988.485939:0:8897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239676288 00000100:00100000:0.0:1787579988.485948:0:8897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239676288 00000100:00100000:0.0:1787579988.486034:0:8897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 13 00000100:00100000:0.0:1787579988.486044:0:8897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d662d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8d66e8ae-0b45-4a46-9f01-8e93d52be8ea+6:8166:x1874413239676288:12345-192.168.202.36@tcp:40:mount.lustre.0 00000100:00100000:0.0:1787579988.486096:0:8897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d662d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8d66e8ae-0b45-4a46-9f01-8e93d52be8ea+6:8166:x1874413239676288:12345-192.168.202.36@tcp:40:mount.lustre.0 Request processed in 54us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579988.486102:0:8897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 13 00000100:00100000:2.0:1787579988.491635:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787579988.491679:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787579988.491730:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787579988.491881:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239676416 00000100:00100000:3.0:1787579988.491887:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239676672 00000100:00100000:3.0:1787579988.491895:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239676672 00000100:00100000:1.0:1787579988.491895:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239676416 00000100:00100000:1.0:1787579988.491952:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239676544 00000100:00100000:1.0:1787579988.491956:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239676544 00000100:00100000:3.0:1787579988.491964:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 1 00000100:00100000:1.0:1787579988.491978:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 12 00000100:00100000:3.0:1787579988.491980:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae77a89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8d66e8ae-0b45-4a46-9f01-8e93d52be8ea+6:8166:x1874413239676672:12345-192.168.202.36@tcp:33:mount.lustre.0 00000100:00100000:1.0:1787579988.492016:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae77a8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2357:x1874413239676416:12345-192.168.202.36@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787579988.492042:0:6707:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 8d66e8ae-0b45-4a46-9f01-8e93d52be8ea@192.168.202.36@tcp t0 exp 0000000000000000 cur 336 last 0 00000020:00000080:1.0:1787579988.492071:0:6707:0:(genops.c:1385:class_connect()) connect: client 8d66e8ae-0b45-4a46-9f01-8e93d52be8ea, cookie 0xc86deac2083377b8 00002000:00100000:1.0:1787579988.492083:0:6707:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 8d66e8ae-0b45-4a46-9f01-8e93d52be8ea/ffff8fae6d366000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787579988.492107:0:6707:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000004:00200000:3.0:1787579988.492196:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00002000:00080000:1.0:1787579988.492358:0:6707:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:3.0:1787579988.492373:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae77a89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8d66e8ae-0b45-4a46-9f01-8e93d52be8ea+6:8166:x1874413239676672:12345-192.168.202.36@tcp:33:mount.lustre.0 Request processed in 396us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579988.492405:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 1 00000100:00080000:1.0:1787579988.492413:0:6707:0:(import.c:65:import_set_state_nolock()) ffff8fae6d366800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787579988.492448:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae77a8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8d66e8ae-0b45-4a46-9f01-8e93d52be8ea+6:2357:x1874413239676416:12345-192.168.202.36@tcp:8:mount.lustre.0 Request processed in 433us (824us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579988.492457:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 12 00000100:00100000:1.0:1787579988.492474:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 13 00000100:00100000:1.0:1787579988.492480:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae77a89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2357:x1874413239676544:12345-192.168.202.36@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787579988.492495:0:6707:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 8d66e8ae-0b45-4a46-9f01-8e93d52be8ea@192.168.202.36@tcp t0 exp 0000000000000000 cur 336 last 0 00000020:00000080:1.0:1787579988.492511:0:6707:0:(genops.c:1385:class_connect()) connect: client 8d66e8ae-0b45-4a46-9f01-8e93d52be8ea, cookie 0xc86deac2083377bf 00002000:00100000:1.0:1787579988.492516:0:6707:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 8d66e8ae-0b45-4a46-9f01-8e93d52be8ea/ffff8fae6d367000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787579988.492522:0:6707:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787579988.492653:0:6707:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787579988.492668:0:6707:0:(import.c:65:import_set_state_nolock()) ffff8fae6d365000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787579988.492709:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae77a89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8d66e8ae-0b45-4a46-9f01-8e93d52be8ea+6:2357:x1874413239676544:12345-192.168.202.36@tcp:8:mount.lustre.0 Request processed in 219us (1020us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579988.492715:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 13 00010000:00010000:3.0:1787579989.492308:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579990.515973:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579991.551973:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787579992.180239:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787579992.180263:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7e97df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262779520:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787579992.180332:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579992.180436:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262779520 00000100:00100000:0.0:1787579992.180445:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262779520 00000100:00100000:0.0:1787579992.180514:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787579992.180524:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7e97ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262779520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787579992.180561:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787579992.180609:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7e97ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262779520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579992.180616:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:0.0:1787579992.180636:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787579992.180675:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae7e97df80 x1874413262779520/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787580008 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787579992.180694:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7e97df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262779520:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787579992.568131:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787579992.712530:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787579992.712563:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d661c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1874413262779904:0@lo:400:kworker.0 00000100:00100000:3.0:1787579992.712653:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579992.712740:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262779904 00000100:00100000:3.0:1787579992.712748:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262779904 00000100:00100000:3.0:1787579992.712808:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787579992.712820:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fad43124a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874413262779904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787579992.712880:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fad43124a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874413262779904:12345-0@lo:400:kworker.0 Request processed in 62us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579992.712888:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787579992.712933:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d661c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1874413262779904:0@lo:400:kworker.0 00000100:00100000:3.0:1787579992.712969:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fad43127b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874413262780032:0@lo:400:kworker.0 00000100:00100000:1.0:1787579992.712988:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d660e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3314:1874413262779648:0@lo:400:kworker.0 00000100:00100000:3.0:1787579992.712998:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579992.713022:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579992.713117:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d661500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874413262779776:0@lo:400:kworker.0 00000100:00100000:1.0:1787579992.713163:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fad43127480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874413262780160:0@lo:400:kworker.0 00000100:00100000:3.0:1787579992.713223:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262779648 00000100:00100000:3.0:1787579992.713228:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262779648 00000100:00100000:3.0:1787579992.713256:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1787579992.713263:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:3314:x1874413262779648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787579992.713576:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262780032 00000100:00100000:2.0:1787579992.713582:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262780032 00000100:00100000:2.0:1787579992.713615:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787579992.713623:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fad43127800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1874413262780032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787579992.715841:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579992.715905:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fad43127100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874413262780288:0@lo:400:kworker.0 00000100:00100000:0.0:1787579992.715939:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787579992.715986:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787579992.716003:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262779776 00000100:00100000:0.0:1787579992.716010:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262779776 00000100:00100000:0.0:1787579992.716059:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787579992.716067:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7e97df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874413262779776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787579992.716113:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7e97df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874413262779776:12345-0@lo:400:kworker.0 Request processed in 47us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579992.716120:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787579992.716140:0:6708:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1787579992.716146:0:6708:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1787579992.717653:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d661500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874413262779776:0@lo:400:kworker.0 00000100:00100000:1.0:1787579992.723127:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787579992.727947:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262780160 00000100:00100000:3.0:1787579992.727969:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262780160 00000100:00100000:3.0:1787579992.728044:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787579992.728056:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae45279f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874413262780160:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787579992.728072:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787579992.728158:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae45279f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874413262780160:12345-0@lo:400:kworker.0 Request processed in 103us (5039us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579992.728166:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787579992.728210:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:3314:x1874413262779648:12345-0@lo:400:kworker.0 Request processed in 14946us (15185us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579992.728225:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1787579992.728689:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fad43127480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874413262780160:0@lo:400:kworker.0 00000100:00100000:0.0:1787579992.728702:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d660e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3314:1874413262779648:0@lo:400:kworker.0 00000100:00100000:2.0:1787579992.730148:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fad43127800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1874413262780032:12345-0@lo:400:kworker.0 Request processed in 16518us (17141us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579992.730450:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787579992.730477:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262780288 00000100:00100000:2.0:1787579992.730484:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262780288 00000100:00100000:2.0:1787579992.731553:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787579992.731563:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7e97e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1874413262780288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787579992.731644:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7e97e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1874413262780288:12345-0@lo:400:kworker.0 Request processed in 83us (15705us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579992.731651:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:2.0:1787579992.731857:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fad43127100 x1874413262780288/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787580008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787579992.731895:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fad43127100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874413262780288:0@lo:400:kworker.0 00010000:00080000:3.0:1787579992.732062:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fad43127b80 x1874413262780032/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787580008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787579992.732072:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fad43127b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874413262780032:0@lo:400:kworker.0 00000100:00080000:0.0:1787579992.735454:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:1.0:1787579992.797849:0:5874:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 8d66e8ae-0b45-4a46-9f01-8e93d52be8ea 00000100:00100000:1.0:1787579993.212189:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae4527aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262780416:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787579993.212275:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787579993.212353:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262780416 00000100:00100000:1.0:1787579993.212361:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262780416 00000100:00100000:1.0:1787579993.212434:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787579993.212444:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae4527a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262780416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787579993.212493:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787579993.212541:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae4527a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262780416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579993.212549:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:1.0:1787579993.213107:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae4527aa00 x1874413262780416/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787580009 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787579993.213127:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae4527aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262780416:0@lo:13:osp-pre-1-0.0 00000001:00100000:2.0:1787579993.366769:0:7653:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8d66e8ae-0b45-4a46-9f01-8e93d52be8ea 00000001:00100000:3.0:1787579993.411249:0:6733:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8d66e8ae-0b45-4a46-9f01-8e93d52be8ea 00000100:00100000:2.0:1787579993.544685:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787579993.544734:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787579993.544778:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787579993.544814:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787579993.544839:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239676928 00000100:00100000:2.0:1787579993.544843:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787579993.544853:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239676928 00000100:00100000:2.0:1787579993.544864:0:8897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239677056 00000100:00100000:2.0:1787579993.544868:0:8897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239677056 00000100:00100000:1.0:1787579993.544933:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239676800 00000100:00100000:1.0:1787579993.544940:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239676800 00000100:00100000:0.0:1787579993.544950:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 75 00000100:00100000:1.0:1787579993.544985:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 225 00000100:00100000:1.0:1787579993.544997:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ff68ada-0c43-4367-93b7-ad31684360cf+13:2359:x1874413239676800:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:3.0:1787579993.545006:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239677184 00000100:00100000:3.0:1787579993.545012:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239677184 00000100:00100000:3.0:1787579993.545061:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239677312 00000100:00100000:3.0:1787579993.545065:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239677312 00000100:00100000:1.0:1787579993.545088:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ff68ada-0c43-4367-93b7-ad31684360cf+13:2359:x1874413239676800:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 93us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579993.545097:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 37 00000100:00100000:1.0:1787579993.545102:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 225 00000100:00100000:3.0:1787579993.545112:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae77a8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8d66e8ae-0b45-4a46-9f01-8e93d52be8ea+5:2359:x1874413239677184:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:3.0:1787579993.545152:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae77a8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8d66e8ae-0b45-4a46-9f01-8e93d52be8ea+5:2359:x1874413239677184:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 45us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579993.545172:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 37 00000100:00100000:3.0:1787579993.545193:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 38 00000100:00100000:3.0:1787579993.545202:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae77a88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8d66e8ae-0b45-4a46-9f01-8e93d52be8ea+5:2359:x1874413239677312:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:3.0:1787579993.545229:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae77a88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8d66e8ae-0b45-4a46-9f01-8e93d52be8ea+5:2359:x1874413239677312:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 29us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579993.545235:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 38 00000100:00080000:1.0:1787579993.545293:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787579993.545299:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787579993.545317:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787579993.549966:0:8897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 76 00000100:00100000:3.0:1787579993.549985:0:8897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae77a88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8d66e8ae-0b45-4a46-9f01-8e93d52be8ea+5:2359:x1874413239677056:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:3.0:1787579993.550098:0:8897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae77a88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8d66e8ae-0b45-4a46-9f01-8e93d52be8ea+5:2359:x1874413239677056:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 119us (5282us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579993.550122:0:8897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 76 00000100:00100000:0.0:1787579993.560013:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae77a8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:2359:x1874413239676928:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:3.0:1787579993.560268:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae77a8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:2359:x1874413239676928:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 15306us (15614us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579993.560281:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 75 00010000:00010000:3.0:1787579993.591734:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579994.613420:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579995.636361:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787579996.358792:0:10329:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg236-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:3.0:1787579996.668109:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787579997.299704:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787579997.299727:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7e97c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262780544:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787579997.299803:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787579997.299867:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262780544 00000100:00100000:2.0:1787579997.299874:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262780544 00000100:00100000:2.0:1787579997.299930:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787579997.299939:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae77a88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262780544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787579997.299988:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787579997.300030:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae77a88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262780544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1787579997.300037:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:2.0:1787579997.300057:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787579997.300085:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae7e97c700 x1874413262780544/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787580013 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787579997.300104:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7e97c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262780544:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787579997.687596:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787579997.815809:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7e97c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874413262780800:0@lo:400:kworker.0 00000100:00100000:0.0:1787579997.815879:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579997.815950:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787579997.815956:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7e97ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3315:1874413262780672:0@lo:400:kworker.0 00000100:00100000:0.0:1787579997.815986:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579997.816009:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7e97c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874413262781184:0@lo:400:kworker.0 00000100:00100000:0.0:1787579997.816032:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579997.816057:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7e97d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874413262780928:0@lo:400:kworker.0 00000100:00100000:0.0:1787579997.816082:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579997.816103:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787579997.816108:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7e97c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1874413262781056:0@lo:400:kworker.0 00000100:00100000:0.0:1787579997.816128:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579997.816159:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262780672 00000100:00100000:0.0:1787579997.816168:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262780672 00000100:00100000:0.0:1787579997.816216:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1787579997.816226:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:3315:x1874413262780672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787579997.816294:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:3315:x1874413262780672:12345-0@lo:400:kworker.0 Request processed in 69us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579997.816301:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1787579997.816338:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262781184 00000100:00100000:0.0:1787579997.816343:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262781184 00000100:00080000:3.0:1787579997.816371:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787579997.816379:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787579997.816405:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7e97f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1874413262781184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787579997.816444:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7e97f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1874413262781184:12345-0@lo:400:kworker.0 Request processed in 35us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579997.816451:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787579997.816469:0:8897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262780800 00000100:00100000:0.0:1787579997.816472:0:8897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262780800 00000100:00100000:0.0:1787579997.816500:0:8897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262780928 00000100:00100000:0.0:1787579997.816504:0:8897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262780928 00000100:00100000:0.0:1787579997.816523:0:8897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262781056 00000100:00100000:0.0:1787579997.816525:0:8897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262781056 00000100:00100000:3.0:1787579997.816556:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787579997.816565:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7e97d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874413262780800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787579997.816602:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7e97d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874413262780800:12345-0@lo:400:kworker.0 Request processed in 39us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579997.816608:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787579997.816631:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787579997.816637:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7e97d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874413262780928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787579997.816673:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7e97d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874413262780928:12345-0@lo:400:kworker.0 Request processed in 36us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579997.820174:0:8897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787579997.820197:0:8897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874413262781056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787579997.820295:0:8897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874413262781056:12345-0@lo:400:kworker.0 Request processed in 108us (4165us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579997.820304:0:8897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:0.0:1787579997.820356:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787579997.820408:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7e97c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1874413262781056:0@lo:400:kworker.0 00000100:00100000:0.0:1787579997.820423:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7e97d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874413262780928:0@lo:400:kworker.0 00000100:00100000:0.0:1787579997.820460:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7e97ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3315:1874413262780672:0@lo:400:kworker.0 00010000:00080000:0.0:1787579997.820475:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae7e97c700 x1874413262781184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787580013 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787579997.820498:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7e97c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874413262781184:0@lo:400:kworker.0 00000100:00100000:0.0:1787579997.820512:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7e97c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874413262780800:0@lo:400:kworker.0 00000100:00100000:3.0:1787579997.820858:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787579998.325627:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae4527aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874413262781312:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787579998.325705:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787579998.325791:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262781312 00000100:00100000:0.0:1787579998.325799:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262781312 00000100:00100000:0.0:1787579998.325853:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787579998.325864:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7e97c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874413262781312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787579998.325903:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787579998.325946:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7e97c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874413262781312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1787579998.325953:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:0.0:1787579998.325993:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae4527aa00 x1874413262781312/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787580014 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787579998.326012:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae4527aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874413262781312:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787579998.683640:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787579998.683676:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787579998.683714:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787579998.683736:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787579998.683764:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787579998.683792:0:8897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239677696 00000100:00100000:1.0:1787579998.683801:0:8897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239677696 00000100:00100000:1.0:1787579998.683860:0:8897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239677568 00000100:00100000:1.0:1787579998.683863:0:8897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239677568 00000100:00100000:1.0:1787579998.683887:0:8897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 80 00000100:00100000:1.0:1787579998.683897:0:8897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae45278700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8d66e8ae-0b45-4a46-9f01-8e93d52be8ea+5:2361:x1874413239677696:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:1.0:1787579998.683979:0:8897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae45278700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8d66e8ae-0b45-4a46-9f01-8e93d52be8ea+5:2361:x1874413239677696:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 83us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579998.683987:0:8897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 80 00000100:00100000:1.0:1787579998.684006:0:8897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 81 00000100:00100000:1.0:1787579998.684014:0:8897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae45278e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:2360:x1874413239677568:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:1.0:1787579998.684037:0:8897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae45278e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:2360:x1874413239677568:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 26us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579998.684043:0:8897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 81 00000100:00100000:1.0:1787579998.684067:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239677952 00000100:00100000:1.0:1787579998.684070:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239677952 00000100:00100000:1.0:1787579998.684096:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239677824 00000100:00100000:1.0:1787579998.684099:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239677824 00000100:00100000:1.0:1787579998.684119:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 40 00000100:00100000:1.0:1787579998.684125:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae45278000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8d66e8ae-0b45-4a46-9f01-8e93d52be8ea+5:2361:x1874413239677952:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:1.0:1787579998.684152:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae45278000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8d66e8ae-0b45-4a46-9f01-8e93d52be8ea+5:2361:x1874413239677952:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 27us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579998.684179:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 40 00000100:00100000:1.0:1787579998.684192:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 41 00000100:00100000:1.0:1787579998.684198:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae4527aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8d66e8ae-0b45-4a46-9f01-8e93d52be8ea+5:2360:x1874413239677824:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:1.0:1787579998.684251:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae4527aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8d66e8ae-0b45-4a46-9f01-8e93d52be8ea+5:2360:x1874413239677824:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 54us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1787579998.684258:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 41 00000100:00080000:1.0:1787579998.684276:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787579998.684280:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787579998.684283:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787579998.684524:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239677440 00000100:00100000:3.0:1787579998.684529:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239677440 00000100:00100000:3.0:1787579998.684566:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 227 00000100:00100000:3.0:1787579998.684574:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ff68ada-0c43-4367-93b7-ad31684360cf+13:2360:x1874413239677440:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:3.0:1787579998.684619:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ff68ada-0c43-4367-93b7-ad31684360cf+13:2360:x1874413239677440:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 45us (989us total) trans 0 rc 0/0 00000100:00100000:3.0:1787579998.684637:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 227 00010000:00010000:2.0:1787579998.716571:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787579999.736692:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787580000.757953:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787580001.784149:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787580002.419892:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787580002.424784:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7e97c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874413262781440:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787580002.424880:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580002.425054:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262781440 00000100:00100000:0.0:1787580002.425064:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262781440 00000100:00100000:0.0:1787580002.425134:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787580002.425145:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae77a89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874413262781440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787580002.425183:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787580002.425231:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae77a89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874413262781440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580002.425238:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:2.0:1787580002.428812:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787580002.428881:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae7e97c700 x1874413262781440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787580018 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787580002.428906:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7e97c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874413262781440:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787580002.803742:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787580002.931801:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5ff1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1874413262781952:0@lo:400:kworker.0 00000100:00100000:0.0:1787580002.931882:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580002.931960:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787580002.931967:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae77a88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3316:1874413262781568:0@lo:400:kworker.0 00000100:00100000:0.0:1787580002.932000:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580002.932023:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5ff1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262782080:0@lo:400:kworker.0 00000100:00100000:0.0:1787580002.932053:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580002.932083:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae77a89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1874413262781824:0@lo:400:kworker.0 00000100:00100000:0.0:1787580002.932106:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580002.932127:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787580002.932132:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae77a8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874413262781696:0@lo:400:kworker.0 00000100:00100000:0.0:1787580002.932153:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580002.932184:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262781568 00000100:00100000:0.0:1787580002.932192:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262781568 00000100:00100000:0.0:1787580002.932242:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1787580002.932252:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:3316:x1874413262781568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787580002.932306:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:3316:x1874413262781568:12345-0@lo:400:kworker.0 Request processed in 55us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580002.932314:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1787580002.932347:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262782080 00000100:00100000:0.0:1787580002.932351:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262782080 00000100:00100000:0.0:1787580002.932413:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787580002.932421:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5f6a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262782080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787580002.932452:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5f6a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262782080:12345-0@lo:400:kworker.0 Request processed in 33us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580002.932459:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787580002.932636:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262781952 00000100:00100000:0.0:1787580002.932640:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262781952 00000100:00100000:0.0:1787580002.932665:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262781824 00000100:00100000:0.0:1787580002.932668:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262781824 00000100:00100000:0.0:1787580002.932681:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262781696 00000100:00100000:0.0:1787580002.932683:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262781696 00000100:00100000:0.0:1787580002.932694:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787580002.932700:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7e97ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874413262781952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787580002.932731:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7e97ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874413262781952:12345-0@lo:400:kworker.0 Request processed in 31us (850us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580002.932736:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787580002.932747:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787580002.932752:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7e97d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874413262781824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787580002.932777:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7e97d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874413262781824:12345-0@lo:400:kworker.0 Request processed in 25us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580002.932783:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787580002.932792:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787580002.932797:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7e97c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874413262781696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787580002.932818:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7e97c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874413262781696:12345-0@lo:400:kworker.0 Request processed in 21us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580002.932823:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:0.0:1787580002.932844:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787580002.932849:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787580002.932882:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae77a8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874413262781696:0@lo:400:kworker.0 00000100:00100000:0.0:1787580002.932892:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae77a89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1874413262781824:0@lo:400:kworker.0 00000100:00100000:0.0:1787580002.932919:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae77a88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3316:1874413262781568:0@lo:400:kworker.0 00010000:00080000:0.0:1787580002.932943:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae5ff1dc00 x1874413262782080/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787580018 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787580002.932953:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5ff1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262782080:0@lo:400:kworker.0 00000100:00100000:0.0:1787580002.932963:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5ff1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1874413262781952:0@lo:400:kworker.0 00000100:00100000:0.0:1787580003.453687:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7e97f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874413262782208:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787580003.453771:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580003.453996:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262782208 00000100:00100000:0.0:1787580003.454004:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262782208 00000100:00100000:0.0:1787580003.454087:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787580003.454096:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7e97fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874413262782208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787580003.454132:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787580003.454179:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7e97fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874413262782208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580003.454186:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:0.0:1787580003.454236:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae7e97f480 x1874413262782208/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787580019 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787580003.454256:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7e97f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874413262782208:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787580003.799204:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580003.799249:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580003.799275:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580003.799292:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580003.799314:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580003.799342:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239678336 00000100:00100000:1.0:1787580003.799352:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239678336 00000100:00100000:1.0:1787580003.799439:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239678208 00000100:00100000:1.0:1787580003.799443:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239678208 00000100:00100000:1.0:1787580003.799659:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 85 00000100:00100000:1.0:1787580003.799672:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae45279c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d66e8ae-0b45-4a46-9f01-8e93d52be8ea+5:2359:x1874413239678336:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:1.0:1787580003.799752:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae45279c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d66e8ae-0b45-4a46-9f01-8e93d52be8ea+5:2359:x1874413239678336:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 83us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580003.799760:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 85 00000100:00100000:1.0:1787580003.799844:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 86 00000100:00100000:1.0:1787580003.799865:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae4527b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:2359:x1874413239678208:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:1.0:1787580003.799892:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae4527b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:2359:x1874413239678208:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 28us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580003.799898:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 86 00000100:00100000:1.0:1787580003.799917:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239678592 00000100:00100000:1.0:1787580003.799921:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239678592 00000100:00100000:1.0:1787580003.799946:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239678464 00000100:00100000:1.0:1787580003.799949:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239678464 00000100:00100000:1.0:1787580003.799968:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 43 00000100:00100000:1.0:1787580003.799975:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae45279500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8d66e8ae-0b45-4a46-9f01-8e93d52be8ea+5:2359:x1874413239678592:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:1.0:1787580003.799999:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae45279500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8d66e8ae-0b45-4a46-9f01-8e93d52be8ea+5:2359:x1874413239678592:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 25us (723us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580003.800005:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 43 00000100:00100000:1.0:1787580003.800015:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 44 00000100:00100000:1.0:1787580003.800022:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae45278a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8d66e8ae-0b45-4a46-9f01-8e93d52be8ea+5:2359:x1874413239678464:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:1.0:1787580003.800045:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae45278a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8d66e8ae-0b45-4a46-9f01-8e93d52be8ea+5:2359:x1874413239678464:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 24us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580003.800051:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 44 00000100:00080000:1.0:1787580003.800073:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787580003.800077:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787580003.800079:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787580003.800925:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239678080 00000100:00100000:2.0:1787580003.800934:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239678080 00000100:00100000:2.0:1787580003.800968:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 229 00000100:00100000:2.0:1787580003.800976:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ff68ada-0c43-4367-93b7-ad31684360cf+13:2359:x1874413239678080:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:2.0:1787580003.801008:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ff68ada-0c43-4367-93b7-ad31684360cf+13:2359:x1874413239678080:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 34us (1818us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580003.801015:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 229 00010000:00010000:1.0:1787580003.831118:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787580004.865516:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787580005.875698:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787580006.900916:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787580007.543351:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae45278380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874413262782336:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787580007.543450:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787580007.543536:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262782336 00000100:00100000:1.0:1787580007.543558:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262782336 00000100:00100000:1.0:1787580007.543618:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787580007.543629:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae4527bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874413262782336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787580007.543664:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787580007.543713:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae4527bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874413262782336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580007.543721:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:1.0:1787580007.543743:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787580007.543778:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae45278380 x1874413262782336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787580023 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787580007.543797:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae45278380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874413262782336:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787580007.923644:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787580008.051728:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5ff1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874413262782720:0@lo:400:kworker.0 00000100:00100000:2.0:1787580008.051800:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787580008.051856:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787580008.051863:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5ff1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874413262782848:0@lo:400:kworker.0 00000100:00100000:2.0:1787580008.051886:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787580008.051921:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262782720 00000100:00100000:2.0:1787580008.051928:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262782720 00000100:00100000:2.0:1787580008.051977:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262782848 00000100:00100000:2.0:1787580008.051980:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262782848 00000100:00100000:2.0:1787580008.052007:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787580008.052030:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5ff1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874413262782720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787580008.052083:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5ff1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874413262782720:12345-0@lo:400:kworker.0 Request processed in 55us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580008.052091:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787580008.052111:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787580008.052118:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5ff1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874413262782848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787580008.052144:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5ff1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874413262782848:12345-0@lo:400:kworker.0 Request processed in 27us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580008.052150:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:2.0:1787580008.052169:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787580008.052210:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5ff1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874413262782848:0@lo:400:kworker.0 00000100:00100000:2.0:1787580008.052221:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5ff1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874413262782720:0@lo:400:kworker.0 00000100:00100000:0.0:1787580008.052247:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5ff1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3316:1874413262782464:0@lo:400:kworker.0 00000100:00100000:2.0:1787580008.052257:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5ff1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874413262782592:0@lo:400:kworker.0 00000100:00100000:2.0:1787580008.052277:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580008.052280:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787580008.052300:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262782592 00000100:00100000:0.0:1787580008.052301:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5ff1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262782976:0@lo:400:kworker.0 00000100:00100000:2.0:1787580008.052303:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262782592 00000100:00100000:2.0:1787580008.052322:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787580008.052324:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787580008.052328:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5ff1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874413262782592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787580008.052358:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5ff1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874413262782592:12345-0@lo:400:kworker.0 Request processed in 30us (80us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580008.052365:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787580008.052368:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262782464 00000100:00100000:0.0:1787580008.052372:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262782464 00000100:00100000:2.0:1787580008.052404:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5ff1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874413262782592:0@lo:400:kworker.0 00000100:00100000:0.0:1787580008.052413:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1787580008.052425:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:3316:x1874413262782464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787580008.052467:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:3316:x1874413262782464:12345-0@lo:400:kworker.0 Request processed in 42us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580008.052475:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1787580008.052503:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262782976 00000100:00100000:0.0:1787580008.052506:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262782976 00000100:00100000:0.0:1787580008.052548:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787580008.052554:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7e97f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262782976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787580008.052591:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7e97f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262782976:12345-0@lo:400:kworker.0 Request processed in 38us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580008.052597:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:0.0:1787580008.052614:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787580008.055917:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5ff1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3316:1874413262782464:0@lo:400:kworker.0 00010000:00080000:2.0:1787580008.055943:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae5ff1d180 x1874413262782976/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787580024 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787580008.055979:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5ff1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262782976:0@lo:400:kworker.0 00000100:00100000:3.0:1787580008.566181:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5ff1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874413262783104:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787580008.566253:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580008.566460:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262783104 00000100:00100000:0.0:1787580008.566469:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262783104 00000100:00100000:0.0:1787580008.566531:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787580008.566540:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fad43127b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874413262783104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787580008.566575:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787580008.566621:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fad43127b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874413262783104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580008.566629:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:3.0:1787580008.568006:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae5ff1d180 x1874413262783104/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787580024 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787580008.568030:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5ff1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874413262783104:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787580008.905061:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580008.905119:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580008.905149:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580008.905170:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580008.905196:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580008.905226:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239679104 00000100:00100000:1.0:1787580008.905235:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239679104 00000100:00100000:1.0:1787580008.905285:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239679232 00000100:00100000:1.0:1787580008.905289:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239679232 00000100:00100000:1.0:1787580008.905311:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 14 00000100:00100000:1.0:1787580008.905320:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae4527b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8d66e8ae-0b45-4a46-9f01-8e93d52be8ea+5:2357:x1874413239679104:12345-192.168.202.36@tcp:9:kworker.0 00000020:00000080:1.0:1787580008.905348:0:6707:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc86deac2083377b8 00000100:00080000:1.0:1787580008.905356:0:6707:0:(import.c:65:import_set_state_nolock()) ffff8fae6d366800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787580008.905419:0:6707:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1787580008.905718:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239678720 00000100:00100000:0.0:1787580008.905723:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239678720 00000100:00100000:0.0:1787580008.905753:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 231 00000100:00100000:0.0:1787580008.905761:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ff68ada-0c43-4367-93b7-ad31684360cf+13:2361:x1874413239678720:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:0.0:1787580008.905819:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ff68ada-0c43-4367-93b7-ad31684360cf+13:2361:x1874413239678720:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 59us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580008.905840:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 231 00000100:00080000:0.0:1787580008.905870:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787580008.905874:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787580008.905885:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 15 00000100:00100000:0.0:1787580008.905892:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae4527ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8d66e8ae-0b45-4a46-9f01-8e93d52be8ea+5:2357:x1874413239679232:12345-192.168.202.36@tcp:9:kworker.0 00000020:00000080:0.0:1787580008.905905:0:6705:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc86deac2083377bf 00000100:00080000:0.0:1787580008.905910:0:6705:0:(import.c:65:import_set_state_nolock()) ffff8fae6d365000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787580008.905935:0:6705:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1787580008.906183:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae4527ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8d66e8ae-0b45-4a46-9f01-8e93d52be8ea+2:2357:x1874413239679232:12345-192.168.202.36@tcp:9:kworker.0 Request processed in 290us (984us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580008.906189:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 15 00010000:00010000:0.0:1787580008.906325:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787580008.906501:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239678848 00000100:00100000:2.0:1787580008.906505:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239678848 00000100:00100000:2.0:1787580008.906557:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239678976 00000100:00100000:2.0:1787580008.906561:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239678976 00000100:00100000:2.0:1787580008.906585:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 90 00000100:00100000:2.0:1787580008.906604:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae45278380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:2361:x1874413239678848:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:2.0:1787580008.906642:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae45278380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:2361:x1874413239678848:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 51us (1592us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580008.906649:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 90 00000100:00100000:2.0:1787580008.906661:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 91 00000100:00100000:2.0:1787580008.906667:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae45279880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8d66e8ae-0b45-4a46-9f01-8e93d52be8ea+5:2361:x1874413239678976:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:2.0:1787580008.906688:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae45279880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8d66e8ae-0b45-4a46-9f01-8e93d52be8ea+5:2361:x1874413239678976:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 21us (1538us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580008.906694:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 91 00000100:00100000:1.0:1787580008.907799:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae4527b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8d66e8ae-0b45-4a46-9f01-8e93d52be8ea+2:2357:x1874413239679104:12345-192.168.202.36@tcp:9:kworker.0 Request processed in 2474us (2621us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580008.907822:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 14 00010000:00010000:1.0:1787580008.907851:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787580008.908759:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787580008.948712:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787580009.972281:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787580010.995519:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787580012.024140:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787580012.662627:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fad43125500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874413262783232:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787580012.662698:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580012.662782:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262783232 00000100:00100000:3.0:1787580012.662790:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262783232 00000100:00100000:3.0:1787580012.662842:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787580012.662851:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fad43125c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874413262783232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787580012.662885:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787580012.662928:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fad43125c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874413262783232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580012.662935:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:3.0:1787580012.662956:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787580012.662984:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fad43125500 x1874413262783232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787580028 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787580012.663001:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fad43125500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874413262783232:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787580013.043574:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787580013.180981:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7f5ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874413262783744:0@lo:400:kworker.0 00000100:00100000:0.0:1787580013.181056:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580013.181113:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787580013.181120:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7e97e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3314:1874413262783360:0@lo:400:kworker.0 00000100:00100000:0.0:1787580013.181152:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580013.181175:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7f5b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874413262783872:0@lo:400:kworker.0 00000100:00100000:0.0:1787580013.181198:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580013.181226:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7e97f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874413262783488:0@lo:400:kworker.0 00000100:00100000:0.0:1787580013.181251:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580013.181283:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787580013.181288:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7e97c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874413262783616:0@lo:400:kworker.0 00000100:00100000:0.0:1787580013.181310:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580013.181342:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262783744 00000100:00100000:0.0:1787580013.181348:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262783744 00000100:00100000:0.0:1787580013.181427:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262783488 00000100:00100000:0.0:1787580013.181431:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262783488 00000100:00100000:0.0:1787580013.181446:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262783616 00000100:00100000:0.0:1787580013.181448:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262783616 00000100:00100000:0.0:1787580013.181463:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787580013.181472:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74639f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874413262783744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787580013.181539:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74639f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874413262783744:12345-0@lo:400:kworker.0 Request processed in 67us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580013.181547:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787580013.181564:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787580013.181570:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5f4aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874413262783488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787580013.181601:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5f4aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874413262783488:12345-0@lo:400:kworker.0 Request processed in 31us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580013.181607:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787580013.181617:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787580013.181624:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5f4adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874413262783616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787580013.181649:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5f4adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874413262783616:12345-0@lo:400:kworker.0 Request processed in 26us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580013.181655:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787580013.181685:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262783360 00000100:00100000:0.0:1787580013.181689:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262783360 00000100:00100000:0.0:1787580013.181714:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1787580013.181720:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:3314:x1874413262783360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787580013.181760:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:3314:x1874413262783360:12345-0@lo:400:kworker.0 Request processed in 40us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580013.181766:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1787580013.181793:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262783872 00000100:00100000:0.0:1787580013.181797:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262783872 00000100:00100000:0.0:1787580013.181824:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787580013.181830:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74638700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874413262783872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787580013.181861:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74638700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874413262783872:12345-0@lo:400:kworker.0 Request processed in 31us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580013.181867:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:0.0:1787580013.181889:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787580013.181893:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787580013.181929:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7e97c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874413262783616:0@lo:400:kworker.0 00000100:00100000:0.0:1787580013.181939:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7e97f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874413262783488:0@lo:400:kworker.0 00000100:00100000:0.0:1787580013.181965:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7e97e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3314:1874413262783360:0@lo:400:kworker.0 00010000:00080000:0.0:1787580013.181977:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae7f5b8700 x1874413262783872/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787580029 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787580013.181986:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7f5b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874413262783872:0@lo:400:kworker.0 00000100:00100000:0.0:1787580013.181996:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7f5ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874413262783744:0@lo:400:kworker.0 00000001:02000400:1.0:1787580013.273605:0:11031:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1787580013.690095:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5f4ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262784000:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787580013.690167:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580013.690258:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262784000 00000100:00100000:0.0:1787580013.690266:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262784000 00000100:00100000:0.0:1787580013.690934:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787580013.690955:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5f4adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262784000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787580013.690988:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787580013.691038:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5f4adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262784000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (871us total) trans 0 rc 0/0 00010000:00080000:1.0:1787580013.691272:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae5f4ae300 x1874413262784000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787580029 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787580013.691294:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5f4ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262784000:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787580013.703426:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000001:00100000:0.0:1787580013.743301:0:6733:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8d66e8ae-0b45-4a46-9f01-8e93d52be8ea 00000020:00000080:0.0:1787580013.743310:0:6733:0:(genops.c:885:class_export_put()) final put ffff8fae6d366000/8d66e8ae-0b45-4a46-9f01-8e93d52be8ea 00000020:00000080:0.0:1787580013.743335:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8fae6d366000/8d66e8ae-0b45-4a46-9f01-8e93d52be8ea for lustre-OST0000 00000020:00000080:0.0:1787580013.743374:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8fae6d366800 for lustre-OST0000 00000001:00100000:3.0:1787580013.777950:0:7653:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8d66e8ae-0b45-4a46-9f01-8e93d52be8ea 00000020:00000080:3.0:1787580013.777983:0:7653:0:(genops.c:885:class_export_put()) final put ffff8fae6d367000/8d66e8ae-0b45-4a46-9f01-8e93d52be8ea 00000020:00000080:2.0:1787580013.778113:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8fae6d367000/8d66e8ae-0b45-4a46-9f01-8e93d52be8ea for lustre-OST0001 00000020:00000080:2.0:1787580013.778162:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8fae6d365000 for lustre-OST0001 00000100:00100000:0.0:1787580014.027590:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580014.027679:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580014.027692:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239679360 00000100:00100000:2.0:1787580014.027703:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239679360 00000100:00100000:0.0:1787580014.027728:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580014.027760:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 233 00000100:00100000:2.0:1787580014.027772:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ff68ada-0c43-4367-93b7-ad31684360cf+13:2361:x1874413239679360:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:2.0:1787580014.027842:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ff68ada-0c43-4367-93b7-ad31684360cf+13:2361:x1874413239679360:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 72us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580014.027850:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 233 00000100:00100000:1.0:1787580014.028023:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239679616 00000100:00100000:1.0:1787580014.028028:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239679616 00000100:00100000:1.0:1787580014.028077:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239679488 00000100:00100000:1.0:1787580014.028081:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239679488 00000100:00080000:2.0:1787580014.028090:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787580014.028120:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 95 00000100:00100000:3.0:1787580014.028274:0:8897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 96 00000100:00100000:1.0:1787580014.039151:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5f4ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8d66e8ae-0b45-4a46-9f01-8e93d52be8ea+5:2361:x1874413239679616:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:3.0:1787580014.039152:0:8897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5f4ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:2361:x1874413239679488:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:1.0:1787580014.039974:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5f4ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8d66e8ae-0b45-4a46-9f01-8e93d52be8ea+5:2361:x1874413239679616:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 11841us (12289us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580014.039989:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 95 00000100:00100000:3.0:1787580014.049705:0:8897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5f4ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:2361:x1874413239679488:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 21408us (21960us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580014.049722:0:8897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 96 00010000:00010000:1.0:1787580014.078219:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787580015.091492:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787580016.118414:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787580017.140109:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787580017.445302:0:11181:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd85a94880 20000000:00000080:2.0:1787580017.445320:0:11181:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8fae6d755800 uarg=0000000000000000 20000000:01000000:2.0:1787580017.445358:0:11181:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787580017.445364:0:11181:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787580017.445368:0:11181:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1787580017.454637:0:11182:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1787580017.455115:0:11181:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1787580017.470756:0:11181:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787580017.471286:0:11181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8fae4150ee00/0xc86deac2083377c6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580017.471310:0:11181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fae4150fe00/0xc86deac20833776b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9cff6 expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580017.471320:0:11181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fae50feb600/0xc86deac208337779 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac208337772 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580017.471327:0:11181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fae50feae00/0xc86deac208337787 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac208337780 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580017.471333:0:11181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fae50feb200/0xc86deac208337795 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac20833778e expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580017.471340:0:11181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fae4ca59e00/0xc86deac2083377aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d02e expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580017.471347:0:11181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8fae4150ee00/0xc86deac2083377c6 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580017.471431:0:11181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fae4ca59e00/0xc86deac2083377aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d02e expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580017.471469:0:11181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8fae4ca59e00/0xc86deac2083377aa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d02e expref: 12 pid: 5845 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580017.471485:0:11181:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fad43125500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11181:1874413262784128:192.168.202.36@tcp:104: 00010000:00010000:3.0:1787580017.472019:0:11181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fae50feb200/0xc86deac208337795 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc86deac20833778e expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580017.472029:0:11181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fae50feb200/0xc86deac208337795 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc86deac20833778e expref: 18 pid: 5847 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580017.472038:0:11181:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fad43126a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11181:1874413262784256:0@lo:104: 00000100:00100000:3.0:1787580017.472081:0:11181:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787580017.472122:0:11181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fae50feae00/0xc86deac208337787 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc86deac208337780 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580017.472130:0:11181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fae50feae00/0xc86deac208337787 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc86deac208337780 expref: 18 pid: 5847 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580017.472138:0:11181:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fad43126680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11181:1874413262784384:0@lo:104: 00000100:00100000:3.0:1787580017.472159:0:11181:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787580017.482910:0:11181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fae50feb600/0xc86deac208337779 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc86deac208337772 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580017.482930:0:11181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fae50feb600/0xc86deac208337779 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc86deac208337772 expref: 18 pid: 5845 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580017.482946:0:11181:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fad43127100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11181:1874413262784512:0@lo:104: 00000100:00100000:3.0:1787580017.483007:0:11181:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787580017.485794:0:11181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fae4150fe00/0xc86deac20833776b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9cff6 expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580017.485813:0:11181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8fae4150fe00/0xc86deac20833776b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9cff6 expref: 12 pid: 5845 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580017.485828:0:11181:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d661f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11181:1874413262784640:192.168.202.36@tcp:104: 00000100:00100000:3.0:1787580017.485915:0:11181:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae45228000 going to sleep for 11 seconds 00000100:00100000:3.0:1787580017.486120:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580017.486142:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239679744 00000100:00100000:3.0:1787580017.486149:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239679744 00010000:00010000:3.0:1787580017.486178:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fae4ca59e00/0xc86deac2083377aa lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d02e expref: 13 pid: 5845 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580017.486219:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 25 00000100:00100000:3.0:1787580017.486228:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae52134850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ff68ada-0c43-4367-93b7-ad31684360cf+13:2361:x1874413239679744:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787580017.486239:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787580017.486244:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fae4ca59e00/0xc86deac2083377aa lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d02e expref: 13 pid: 5845 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580017.486256:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fae4ca59e00/0xc86deac2083377aa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d02e expref: 13 pid: 5845 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580017.486276:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787580017.486311:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae52134850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ff68ada-0c43-4367-93b7-ad31684360cf+13:2361:x1874413239679744:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 84us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580017.486318:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 25 00010000:00010000:3.0:1787580017.486416:0:11181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fae4ca59e00/0xc86deac2083377aa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d02e expref: 12 pid: 5845 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580017.486457:0:11181:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fad43125500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11181:1874413262784128:192.168.202.36@tcp:104: 00000100:00100000:2.0:1787580017.491373:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262784256 00000100:00100000:2.0:1787580017.491404:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262784256 00000100:00100000:2.0:1787580017.491462:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262784384 00000100:00100000:2.0:1787580017.491465:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262784384 00000100:00100000:2.0:1787580017.491476:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262784512 00000100:00100000:2.0:1787580017.491479:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262784512 00000100:00100000:2.0:1787580017.491496:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787580017.491506:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fad43125880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+5:11181:x1874413262784256:12345-0@lo:104: 00010000:00010000:2.0:1787580017.491703:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.136@tcp lock: ffff8fae50feaa00/0xc86deac20833778e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc86deac208337795 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580017.491819:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787580017.491827:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fad43125880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+5:11181:x1874413262784256:12345-0@lo:104: Request processed in 322us (19745us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580017.491833:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787580017.491852:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787580017.491859:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fad43127800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+4:11181:x1874413262784384:12345-0@lo:104: 00010000:00010000:2.0:1787580017.491867:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.136@tcp lock: ffff8fae50febc00/0xc86deac208337780 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc86deac208337787 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580017.491900:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787580017.491905:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fad43127800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+4:11181:x1874413262784384:12345-0@lo:104: Request processed in 48us (19746us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580017.491926:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787580017.491939:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787580017.491945:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fad43127480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+3:11181:x1874413262784512:12345-0@lo:104: 00010000:00010000:2.0:1787580017.491953:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.136@tcp lock: ffff8fae50fea000/0xc86deac208337772 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc86deac208337779 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580017.491992:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787580017.491998:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fad43127480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+3:11181:x1874413262784512:12345-0@lo:104: Request processed in 53us (8992us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580017.492003:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:2.0:1787580017.492023:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787580017.492028:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.136@tcp lock: ffff8fae50feaa00/0xc86deac20833778e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc86deac208337795 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580017.492036:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae50feaa00 already unused, calling callback (ffffffffc1b77c20) 10000000:00010000:2.0:1787580017.492041:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.136@tcp lock: ffff8fae50feaa00/0xc86deac20833778e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc86deac208337795 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580017.492050:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: ffff8fae50feaa00/0xc86deac20833778e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc86deac208337795 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787580017.492058:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: ffff8fae50feaa00/0xc86deac20833778e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc86deac208337795 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787580017.492064:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787580017.492206:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787580017.492213:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.136@tcp lock: ffff8fae50febc00/0xc86deac208337780 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc86deac208337787 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580017.492221:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae50febc00 already unused, calling callback (ffffffffc1b77c20) 10000000:00010000:0.0:1787580017.492224:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.136@tcp lock: ffff8fae50febc00/0xc86deac208337780 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc86deac208337787 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580017.492230:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: ffff8fae50febc00/0xc86deac208337780 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc86deac208337787 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787580017.492236:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: ffff8fae50febc00/0xc86deac208337780 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc86deac208337787 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787580017.492241:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787580017.492260:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.136@tcp lock: ffff8fae50febc00/0xc86deac208337780 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac208337787 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580017.492272:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787580017.492295:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.136@tcp lock: ffff8fae50febc00/0xc86deac208337780 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac208337787 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580017.492303:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: ffff8fae50febc00/0xc86deac208337780 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac208337787 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580017.492317:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787580017.492320:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.136@tcp lock: ffff8fae50fea000/0xc86deac208337772 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc86deac208337779 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580017.492326:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae50fea000 already unused, calling callback (ffffffffc1b77c20) 10000000:00010000:0.0:1787580017.492329:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.136@tcp lock: ffff8fae50fea000/0xc86deac208337772 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc86deac208337779 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580017.492336:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: ffff8fae50fea000/0xc86deac208337772 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc86deac208337779 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787580017.492343:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: ffff8fae50fea000/0xc86deac208337772 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc86deac208337779 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787580017.492363:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787580017.492377:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.136@tcp lock: ffff8fae50fea000/0xc86deac208337772 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac208337779 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580017.492411:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787580017.492427:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.136@tcp lock: ffff8fae50fea000/0xc86deac208337772 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac208337779 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580017.492433:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: ffff8fae50fea000/0xc86deac208337772 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac208337779 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580017.492459:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787580017.492461:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787580017.492463:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787580017.492469:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787580017.492491:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7f5bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3314:1874413262784896:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787580017.492817:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580017.492876:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262784896 00000100:00100000:0.0:1787580017.492881:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262784896 00010000:00010000:0.0:1787580017.492907:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fae50feb600/0xc86deac208337779 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc86deac208337772 expref: 19 pid: 5845 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580017.492935:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787580017.492943:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7f5ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:3314:x1874413262784896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787580017.492954:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787580017.492960:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fae50feb600/0xc86deac208337779 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc86deac208337772 expref: 19 pid: 5845 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580017.492970:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fae50feb600/0xc86deac208337779 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc86deac208337772 expref: 19 pid: 5845 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580017.492988:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787580017.493017:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7f5ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:3314:x1874413262784896:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580017.493024:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787580017.493058:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7f5bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3314:1874413262784896:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787580017.493234:0:11181:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fad43126a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11181:1874413262784256:0@lo:104: 00000100:00100000:3.0:1787580017.493245:0:11181:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fad43126680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11181:1874413262784384:0@lo:104: 00010000:00010000:3.0:1787580017.493252:0:11181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fae50feb600/0xc86deac208337779 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc86deac208337772 expref: 18 pid: 5845 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580017.493261:0:11181:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fad43127100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11181:1874413262784512:0@lo:104: 00000100:00100000:0.0:1787580017.493655:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787580017.493668:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5f4ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3316:1874413262784768:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787580017.493709:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580017.493775:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262784768 00000100:00100000:3.0:1787580017.493780:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262784768 00010000:00010000:3.0:1787580017.493799:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fae50feae00/0xc86deac208337787 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc86deac208337780 expref: 18 pid: 5847 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580017.493826:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787580017.493833:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7f5bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+18:3316:x1874413262784768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787580017.493842:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787580017.493846:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fae50feae00/0xc86deac208337787 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc86deac208337780 expref: 18 pid: 5847 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580017.493854:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fae50feae00/0xc86deac208337787 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc86deac208337780 expref: 18 pid: 5847 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580017.493864:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fae50feae00/0xc86deac208337787 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc86deac208337780 expref: 18 pid: 5847 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580017.493873:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787580017.493903:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7f5bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+17:3316:x1874413262784768:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580017.493919:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787580017.493981:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5f4ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3316:1874413262784768:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787580017.494612:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.136@tcp lock: ffff8fae50feaa00/0xc86deac20833778e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac208337795 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580017.494624:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787580017.494678:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5ff1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3315:1874413262785024:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787580017.494727:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787580017.494906:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.136@tcp lock: ffff8fae50feaa00/0xc86deac20833778e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac208337795 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580017.494914:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: ffff8fae50feaa00/0xc86deac20833778e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac208337795 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580017.494935:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787580017.494938:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787580017.494940:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787580017.495025:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262785024 00000100:00100000:0.0:1787580017.495033:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262785024 00010000:00010000:0.0:1787580017.495060:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fae50feb200/0xc86deac208337795 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc86deac20833778e expref: 17 pid: 5847 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580017.495104:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787580017.495113:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d661880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+17:3315:x1874413262785024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787580017.495123:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787580017.495128:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fae50feb200/0xc86deac208337795 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc86deac20833778e expref: 17 pid: 5847 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580017.495140:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fae50feb200/0xc86deac208337795 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc86deac20833778e expref: 17 pid: 5847 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580017.495155:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fae50feb200/0xc86deac208337795 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc86deac20833778e expref: 17 pid: 5847 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580017.495166:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787580017.500940:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d661880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+16:3315:x1874413262785024:12345-0@lo:103:ldlm_bl.0 Request processed in 5814us (6210us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580017.500956:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787580017.501511:0:11181:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d661f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11181:1874413262784640:192.168.202.36@tcp:104: 00010000:00010000:0.0:1787580017.501567:0:11181:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8fae4150ee00/0xc86deac2083377c6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580017.505213:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5ff1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3315:1874413262785024:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787580017.510496:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580017.510651:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239679872 00000100:00100000:0.0:1787580017.510678:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239679872 00010000:00010000:0.0:1787580017.510718:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fae4150fe00/0xc86deac20833776b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9cff6 expref: 12 pid: 5845 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580017.510764:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 29 00000100:00100000:0.0:1787580017.510776:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d660380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ff68ada-0c43-4367-93b7-ad31684360cf+12:2361:x1874413239679872:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787580017.510793:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787580017.510799:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fae4150fe00/0xc86deac20833776b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9cff6 expref: 12 pid: 5845 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580017.510813:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fae4150fe00/0xc86deac20833776b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9cff6 expref: 12 pid: 5845 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580017.510832:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fae4150fe00/0xc86deac20833776b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9cff6 expref: 12 pid: 5845 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580017.510850:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8fae4150ee00/0xc86deac2083377c6 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580017.510859:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fae4150ee00/0xc86deac2083377c6 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580017.510875:0:5838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fae4150ee00/0xc86deac2083377c6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580017.510882:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fae4150ee00/0xc86deac2083377c6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580017.510889:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8fae4150ee00/0xc86deac2083377c6 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580017.510906:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8fae4150ee00/0xc86deac2083377c6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580017.510913:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae4150ee00 already unused, calling callback (ffffffffc155a230) 00010000:00010000:0.0:1787580017.510918:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8fae4150ee00/0xc86deac2083377c6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580017.510926:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8fae4150ee00/0xc86deac2083377c6 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580017.510951:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8fae4150ee00/0xc86deac2083377c6 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580017.510965:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787580017.511036:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d660380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ff68ada-0c43-4367-93b7-ad31684360cf+11:2361:x1874413239679872:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 261us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580017.511045:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 29 00010000:00010000:3.0:1787580017.511674:0:11181:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8fae4150ee00/0xc86deac2083377c6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580017.511686:0:11181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8fae4150ee00/0xc86deac2083377c6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580017.511692:0:11181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fae4150ee00/0xc86deac2083377c6 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580017.780285:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d661180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262785152:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787580017.780356:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787580017.780866:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262785152 00000100:00100000:2.0:1787580017.780876:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262785152 00000100:00100000:2.0:1787580017.780954:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787580017.780965:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7f5b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262785152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787580017.781011:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00010000:00080000:1.0:1787580017.781217:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae6d661180 x1874413262785152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787580033 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787580017.781241:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d661180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262785152:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787580017.781417:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7f5b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262785152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 452us (1060us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580017.781425:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:0.0:1787580017.781813:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787580018.164877:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787580018.294136:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae45278000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3317:1874413262785280:0@lo:400:kworker.0 00000100:00100000:3.0:1787580018.294238:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580018.294378:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262785280 00000100:00100000:0.0:1787580018.294414:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262785280 00000100:00100000:0.0:1787580018.294491:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1787580018.294502:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+16:3317:x1874413262785280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787580018.297429:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7efd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1874413262785536:0@lo:400:kworker.0 00000100:00100000:2.0:1787580018.297521:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787580018.297565:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787580018.297572:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae4527aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874413262785408:0@lo:400:kworker.0 00000100:00100000:2.0:1787580018.297594:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787580018.297625:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262785536 00000100:00100000:2.0:1787580018.297632:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262785536 00000100:00100000:2.0:1787580018.297686:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262785408 00000100:00100000:2.0:1787580018.297689:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262785408 00000100:00100000:2.0:1787580018.297712:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787580018.297721:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5ff1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874413262785536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787580018.297776:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5ff1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874413262785536:12345-0@lo:400:kworker.0 Request processed in 55us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580018.297792:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787580018.297810:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787580018.297816:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5ff1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874413262785408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787580018.297845:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5ff1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874413262785408:12345-0@lo:400:kworker.0 Request processed in 29us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580018.297852:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:2.0:1787580018.297877:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787580018.297905:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae4527aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874413262785408:0@lo:400:kworker.0 00000100:00100000:2.0:1787580018.297916:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7efd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1874413262785536:0@lo:400:kworker.0 00000100:00100000:2.0:1787580018.297963:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7efdaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262785664:0@lo:400:kworker.0 00000100:00100000:2.0:1787580018.297992:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787580018.298030:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262785664 00000100:00100000:2.0:1787580018.298034:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262785664 00000100:00100000:2.0:1787580018.298059:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787580018.298066:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5ff1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262785664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787580018.298100:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5ff1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262785664:12345-0@lo:400:kworker.0 Request processed in 34us (107us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580018.298107:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:2.0:1787580018.298134:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae7efdaa00 x1874413262785664/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787580034 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787580018.298145:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7efdaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262785664:0@lo:400:kworker.0 00000100:00100000:0.0:1787580018.302973:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+16:3317:x1874413262785280:12345-0@lo:400:kworker.0 Request processed in 8461us (8723us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580018.302990:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1787580018.303511:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787580018.303530:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7efd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874413262785920:0@lo:400:kworker.0 00000100:00100000:1.0:1787580018.303596:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787580018.303679:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787580018.303691:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7efda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1874413262785792:0@lo:400:kworker.0 00000100:00100000:2.0:1787580018.303726:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787580018.303939:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262785792 00000100:00100000:1.0:1787580018.303949:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262785792 00000100:00100000:1.0:1787580018.304011:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787580018.304021:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5ff1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874413262785792:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787580018.304198:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787580018.304953:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5ff1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874413262785792:12345-0@lo:400:kworker.0 Request processed in 929us (1222us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580018.304963:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787580018.305185:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7efda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1874413262785792:0@lo:400:kworker.0 00000100:00100000:0.0:1787580018.305335:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262785920 00000100:00100000:0.0:1787580018.305342:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262785920 00000100:00100000:0.0:1787580018.305429:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787580018.305447:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7efd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1874413262785920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787580018.305504:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7efd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1874413262785920:12345-0@lo:400:kworker.0 Request processed in 59us (1908us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580018.305510:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:0.0:1787580018.305551:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae7efd8700 x1874413262785920/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787580034 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787580018.305564:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7efd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874413262785920:0@lo:400:kworker.0 00000100:00080000:2.0:1787580018.305639:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787580018.306920:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae45278000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3317:1874413262785280:0@lo:400:kworker.0 00000100:00100000:3.0:1787580018.804129:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787580018.817356:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fad43127100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874413262786048:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787580018.817458:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580018.817537:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262786048 00000100:00100000:3.0:1787580018.817545:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262786048 00000100:00100000:3.0:1787580018.817596:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787580018.817606:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d660e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874413262786048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787580018.817644:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787580018.817683:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d660e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874413262786048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580018.817702:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:3.0:1787580018.817741:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fad43127100 x1874413262786048/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787580034 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787580018.817760:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fad43127100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874413262786048:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787580019.141315:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580019.141351:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580019.141374:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580019.141441:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239680000 00000100:00100000:2.0:1787580019.141452:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239680000 00000100:00100000:2.0:1787580019.141508:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 235 00000100:00100000:2.0:1787580019.141520:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ff68ada-0c43-4367-93b7-ad31684360cf+11:2360:x1874413239680000:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:2.0:1787580019.141597:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ff68ada-0c43-4367-93b7-ad31684360cf+11:2360:x1874413239680000:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 79us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580019.141606:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 235 00000100:00100000:2.0:1787580019.141639:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239680256 00000100:00100000:2.0:1787580019.141643:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239680256 00000100:00100000:2.0:1787580019.141673:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239680128 00000100:00100000:2.0:1787580019.141675:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239680128 00000100:00100000:2.0:1787580019.141693:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 100 00000100:00100000:2.0:1787580019.141698:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5ff1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8d66e8ae-0b45-4a46-9f01-8e93d52be8ea+5:2360:x1874413239680256:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:2.0:1787580019.141726:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5ff1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8d66e8ae-0b45-4a46-9f01-8e93d52be8ea+5:2360:x1874413239680256:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 28us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580019.141732:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 100 00000100:00100000:2.0:1787580019.141742:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 101 00000100:00100000:2.0:1787580019.141747:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae45278000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:2360:x1874413239680128:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:2.0:1787580019.141766:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae45278000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:2360:x1874413239680128:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 19us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580019.141788:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 101 00000100:00080000:2.0:1787580019.141809:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787580019.191680:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787580019.191953:0:5850:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787580019.191957:0:5850:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8fae77937800 from 7 10000000:01000000:2.0:1787580019.191963:0:5850:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787580019.192016:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae74ed8e00/0xc86deac2083377cd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580019.192029:0:5850:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff8fae74ed8e00/0xc86deac2083377cd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580019.192045:0:5850:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff8fae74ed8e00/0xc86deac2083377cd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580019.192081:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae4527aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262786176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787580019.199885:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580019.199964:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae5f6f6480 going to sleep for 11 seconds 00000100:00100000:1.0:1787580019.204223:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262786176 00000100:00100000:1.0:1787580019.204241:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262786176 00000100:00100000:1.0:1787580019.205847:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1787580019.205864:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+16:5850:x1874413262786176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787580019.205889:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787580019.205911:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fae4ca58000/0xc86deac2083377d4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc86deac2083377cd expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580019.205941:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fae4ca58000/0xc86deac2083377d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc86deac2083377cd expref: 17 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580019.205954:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fae4ca58000/0xc86deac2083377d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac2083377cd expref: 17 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580019.205964:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae4ca58000, rc 0) 00000100:00100000:1.0:1787580019.206058:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+17:5850:x1874413262786176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 199us (6185us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580019.206065:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1787580019.206213:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae4527aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262786176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787580019.206234:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff8fae74ed8e00/0xc86deac2083377cd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac2083377d4 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580019.206243:0:5850:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff8fae74ed8e00/0xc86deac2083377cd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc86deac2083377d4 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580019.206625:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae4527aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262786304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787580019.206664:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787580019.206698:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae5f6f6480 going to sleep for 11 seconds 00000100:00100000:0.0:1787580019.208212:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262786304 00000100:00100000:0.0:1787580019.208223:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262786304 00000100:00100000:0.0:1787580019.208287:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1787580019.208296:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+17:5850:x1874413262786304:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787580019.208624:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+17:5850:x1874413262786304:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 328us (1959us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580019.208633:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1787580019.208696:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae4527aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262786304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787580019.208746:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fad43126680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262786432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787580019.208788:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580019.208822:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae50f2ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1787580019.208920:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262786432 00000100:00100000:2.0:1787580019.208926:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262786432 00000100:00100000:2.0:1787580019.208957:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1787580019.208973:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+17:5850:x1874413262786432:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787580019.209138:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+17:5850:x1874413262786432:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 166us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580019.209146:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1787580019.209371:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fad43126680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262786432:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787580019.212236:0:11211:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787580019.215680:0:5850:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787580019.215713:0:5850:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787580019.215726:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae74ed8e00/0xc86deac2083377cd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac2083377d4 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580019.215740:0:5850:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff8fae74ed8e00/0xc86deac2083377cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac2083377d4 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787580019.215752:0:5850:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787580019.215755:0:5850:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8fae50613000 from 7 10000000:01000000:2.0:1787580019.215758:0:5850:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787580019.215803:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae74ed8200/0xc86deac2083377db lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580019.215812:0:5850:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff8fae74ed8200/0xc86deac2083377db lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580019.215822:0:5850:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff8fae74ed8200/0xc86deac2083377db lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580019.215851:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae4527aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262786560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787580019.215927:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787580019.215992:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae5f6f6480 going to sleep for 11 seconds 00000100:00100000:0.0:1787580019.216344:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262786560 00000100:00100000:0.0:1787580019.216353:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262786560 00000100:00100000:0.0:1787580019.216443:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1787580019.216453:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+17:5850:x1874413262786560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787580019.216467:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787580019.216480:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fae50febc00/0xc86deac2083377e2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc86deac2083377db expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580019.216505:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fae50febc00/0xc86deac2083377e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc86deac2083377db expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580019.216528:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fae50febc00/0xc86deac2083377e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac2083377db expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580019.216537:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae50febc00, rc 0) 00000100:00100000:0.0:1787580019.216590:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+18:5850:x1874413262786560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580019.216597:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1787580019.218895:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae4527aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262786560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787580019.218930:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff8fae74ed8200/0xc86deac2083377db lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac2083377e2 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580019.218964:0:5850:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff8fae74ed8200/0xc86deac2083377db lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc86deac2083377e2 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580019.219056:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae4527aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262786688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787580019.219122:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787580019.219165:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae5f6f6480 going to sleep for 11 seconds 00000100:00100000:0.0:1787580019.219957:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262786688 00000100:00100000:0.0:1787580019.219967:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262786688 00000100:00100000:0.0:1787580019.220015:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1787580019.220026:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+18:5850:x1874413262786688:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787580019.220872:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+18:5850:x1874413262786688:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 845us (1747us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580019.220881:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1787580019.221002:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae4527aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262786688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787580019.221051:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d661500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262786816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787580019.221099:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580019.221131:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae77a320c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787580019.221194:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262786816 00000100:00100000:2.0:1787580019.221200:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262786816 00000100:00100000:2.0:1787580019.221238:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1787580019.221246:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+18:5850:x1874413262786816:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787580019.221655:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+18:5850:x1874413262786816:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 409us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580019.221662:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1787580019.223050:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d661500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262786816:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787580019.225477:0:11212:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1787580019.225690:0:5850:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787580019.225715:0:5850:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787580019.225727:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae74ed8200/0xc86deac2083377db lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac2083377e2 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580019.225739:0:5850:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff8fae74ed8200/0xc86deac2083377db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac2083377e2 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787580019.225752:0:5850:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787580019.225755:0:5850:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8fae6a238800 from 7 10000000:01000000:3.0:1787580019.225758:0:5850:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787580019.225797:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae40031a00/0xc86deac2083377e9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580019.225804:0:5850:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff8fae40031a00/0xc86deac2083377e9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580019.225826:0:5850:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff8fae40031a00/0xc86deac2083377e9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580019.225851:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d661c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262786944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787580019.225923:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580019.225973:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae77a323c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787580019.227573:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262786944 00000100:00100000:1.0:1787580019.227587:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262786944 00000100:00100000:1.0:1787580019.227641:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1787580019.227651:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+18:5850:x1874413262786944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787580019.227667:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787580019.227684:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fae4ca58800/0xc86deac2083377f0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc86deac2083377e9 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580019.227709:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fae4ca58800/0xc86deac2083377f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc86deac2083377e9 expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580019.227719:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fae4ca58800/0xc86deac2083377f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac2083377e9 expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580019.227728:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae4ca58800, rc 0) 00000100:00100000:1.0:1787580019.227789:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:5850:x1874413262786944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (1867us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580019.227795:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1787580019.227891:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d661c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262786944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787580019.227909:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff8fae40031a00/0xc86deac2083377e9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac2083377f0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580019.227919:0:5850:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff8fae40031a00/0xc86deac2083377e9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc86deac2083377f0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580019.227991:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d661c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262787072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787580019.228027:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580019.228065:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae77a323c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787580019.228171:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262787072 00000100:00100000:1.0:1787580019.228176:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262787072 00000100:00100000:1.0:1787580019.228209:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1787580019.228216:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:5850:x1874413262787072:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787580019.228537:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:5850:x1874413262787072:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 321us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580019.228545:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1787580019.228896:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d661c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262787072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787580019.228932:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d661c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262787200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787580019.228975:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580019.229009:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae77a323c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787580019.229141:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262787200 00000100:00100000:1.0:1787580019.229147:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262787200 00000100:00100000:1.0:1787580019.229181:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1787580019.229189:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae487de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:5850:x1874413262787200:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787580019.229361:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae487de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:5850:x1874413262787200:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 172us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580019.229368:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1787580019.229524:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d661c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262787200:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787580019.232975:0:11213:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1787580019.235460:0:5850:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1787580019.235496:0:5850:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787580019.235508:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae40031a00/0xc86deac2083377e9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac2083377f0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580019.235605:0:5850:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff8fae40031a00/0xc86deac2083377e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac2083377f0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580019.276620:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580019.280487:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239680384 00000100:00100000:3.0:1787580019.280504:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239680384 00000100:00100000:3.0:1787580019.280581:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 245 00000100:00100000:3.0:1787580019.280594:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae487df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ff68ada-0c43-4367-93b7-ad31684360cf+11:5603:x1874413239680384:12345-192.168.202.36@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787580019.280628:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787580019.280649:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fae40031000/0xc86deac2083377f7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d058 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580019.280682:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fae40031000/0xc86deac2083377f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d058 expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580019.280693:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fae40031000/0xc86deac2083377f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d058 expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580019.280703:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae40031000, rc 0) 00000100:00100000:3.0:1787580019.280777:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae487df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ff68ada-0c43-4367-93b7-ad31684360cf+12:5603:x1874413239680384:12345-192.168.202.36@tcp:101:ll_cfg_requeue.0 Request processed in 186us (4171us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580019.280785:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 245 00000100:00100000:2.0:1787580019.286927:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580019.287012:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239680512 00000100:00100000:1.0:1787580019.287023:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239680512 00000100:00100000:1.0:1787580019.287089:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 246 00000100:00100000:1.0:1787580019.287100:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae487dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ff68ada-0c43-4367-93b7-ad31684360cf+12:5603:x1874413239680512:12345-192.168.202.36@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787580019.287492:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae487dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ff68ada-0c43-4367-93b7-ad31684360cf+12:5603:x1874413239680512:12345-192.168.202.36@tcp:501:ll_cfg_requeue.0 Request processed in 392us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580019.287502:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 246 00000100:00100000:2.0:1787580019.291095:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580019.291366:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239680640 00000100:00100000:1.0:1787580019.291379:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239680640 00000100:00100000:2.0:1787580019.291855:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 247 00000100:00100000:2.0:1787580019.291866:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae487ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ff68ada-0c43-4367-93b7-ad31684360cf+12:5603:x1874413239680640:12345-192.168.202.36@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787580019.292112:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae487ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ff68ada-0c43-4367-93b7-ad31684360cf+12:5603:x1874413239680640:12345-192.168.202.36@tcp:503:ll_cfg_requeue.0 Request processed in 247us (1027us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580019.292121:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 247 00000100:00100000:2.0:1787580019.297218:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580019.297920:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239680768 00000100:00100000:3.0:1787580019.297933:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239680768 00000100:00100000:2.0:1787580019.298202:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 248 00000100:00100000:2.0:1787580019.298214:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae487df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ff68ada-0c43-4367-93b7-ad31684360cf+12:5603:x1874413239680768:12345-192.168.202.36@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787580019.298232:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787580019.298277:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fae74ed9400/0xc86deac2083377fe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d05f expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580019.298310:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fae74ed9400/0xc86deac2083377fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d05f expref: 13 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580019.298321:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fae74ed9400/0xc86deac2083377fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d05f expref: 13 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580019.298331:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae74ed9400, rc 0) 00000100:00100000:2.0:1787580019.298489:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae487df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ff68ada-0c43-4367-93b7-ad31684360cf+13:5603:x1874413239680768:12345-192.168.202.36@tcp:101:ll_cfg_requeue.0 Request processed in 276us (1281us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580019.298497:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 248 00000100:00100000:3.0:1787580019.301689:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580019.310776:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239680896 00000100:00100000:2.0:1787580019.310798:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239680896 00000100:00100000:2.0:1787580019.310875:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 249 00000100:00100000:2.0:1787580019.310888:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae487dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ff68ada-0c43-4367-93b7-ad31684360cf+13:5603:x1874413239680896:12345-192.168.202.36@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787580019.311451:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae487dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ff68ada-0c43-4367-93b7-ad31684360cf+13:5603:x1874413239680896:12345-192.168.202.36@tcp:501:ll_cfg_requeue.0 Request processed in 564us (9772us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580019.311460:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 249 00000100:00100000:2.0:1787580019.318131:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580019.318299:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239681024 00000100:00100000:1.0:1787580019.318309:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239681024 00000100:00100000:1.0:1787580019.318365:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 250 00000100:00100000:1.0:1787580019.318377:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae487dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ff68ada-0c43-4367-93b7-ad31684360cf+13:5603:x1874413239681024:12345-192.168.202.36@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787580019.318889:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae487dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ff68ada-0c43-4367-93b7-ad31684360cf+13:5603:x1874413239681024:12345-192.168.202.36@tcp:503:ll_cfg_requeue.0 Request processed in 513us (779us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580019.318908:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 250 00010000:00010000:0.0:1787580020.211551:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787580021.242283:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787580022.264197:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787580022.360941:0:11380:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg236-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1787580022.899722:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787580022.906698:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d661c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874413262787328:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787580022.906786:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787580022.912053:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262787328 00000100:00100000:2.0:1787580022.912072:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262787328 00000100:00100000:2.0:1787580022.912530:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787580022.912543:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7efd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874413262787328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787580022.912612:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787580022.912703:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7efd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874413262787328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 163us (5916us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580022.912712:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:1.0:1787580022.916929:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae6d661c00 x1874413262787328/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787580038 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787580022.916965:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d661c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874413262787328:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787580022.917703:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787580023.284578:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787580023.413597:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d661500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874413262787584:0@lo:400:kworker.0 00000100:00100000:0.0:1787580023.413665:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580023.413736:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae74f00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874413262788096:0@lo:400:kworker.0 00000100:00100000:0.0:1787580023.413760:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580023.413787:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787580023.413792:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d661180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874413262787712:0@lo:400:kworker.0 00000100:00100000:0.0:1787580023.413809:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580023.413838:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262787584 00000100:00100000:0.0:1787580023.413845:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262787584 00000100:00100000:0.0:1787580023.413883:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262787712 00000100:00100000:0.0:1787580023.413885:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262787712 00000100:00100000:0.0:1787580023.413911:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787580023.413920:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fad43126680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874413262787584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787580023.413967:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fad43126680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874413262787584:12345-0@lo:400:kworker.0 Request processed in 49us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580023.413974:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787580023.413989:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787580023.413995:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fad43125500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874413262787712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787580023.414432:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d661f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262787840:0@lo:400:kworker.0 00000100:00100000:2.0:1787580023.414481:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787580023.414514:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787580023.414521:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d661c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3316:1874413262787456:0@lo:400:kworker.0 00000100:00100000:2.0:1787580023.414549:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787580023.414571:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae74f01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1874413262787968:0@lo:400:kworker.0 00000100:00100000:2.0:1787580023.414606:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787580023.414632:0:10268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262788096 00000100:00100000:2.0:1787580023.414637:0:10268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262788096 00000100:00100000:3.0:1787580023.414714:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262787968 00000100:00100000:3.0:1787580023.414719:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262787968 00000100:00100000:3.0:1787580023.414743:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787580023.414750:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874413262787968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787580023.414793:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874413262787968:12345-0@lo:400:kworker.0 Request processed in 43us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580023.414799:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:1.0:1787580023.420319:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787580023.420330:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787580023.420440:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d661500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874413262787584:0@lo:400:kworker.0 00000100:00100000:1.0:1787580023.420580:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262787456 00000100:00100000:1.0:1787580023.420589:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262787456 00000100:00100000:1.0:1787580023.420640:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1787580023.420648:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae487dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:3316:x1874413262787456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787580023.420734:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae487dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:3316:x1874413262787456:12345-0@lo:400:kworker.0 Request processed in 86us (6183us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580023.420742:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1787580023.420901:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d661c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3316:1874413262787456:0@lo:400:kworker.0 00000100:00100000:1.0:1787580023.420916:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae74f01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1874413262787968:0@lo:400:kworker.0 00000100:00100000:2.0:1787580023.422077:0:10268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262787840 00000100:00100000:2.0:1787580023.422088:0:10268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262787840 00000100:00100000:0.0:1787580023.422715:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fad43125500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874413262787712:12345-0@lo:400:kworker.0 Request processed in 8716us (8900us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580023.422728:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787580023.422776:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d661180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874413262787712:0@lo:400:kworker.0 00000100:00100000:3.0:1787580023.422939:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787580023.422953:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fad43126a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874413262788096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787580023.423094:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fad43126a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874413262788096:12345-0@lo:400:kworker.0 Request processed in 55us (9241us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580023.423116:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787580023.423133:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787580023.423141:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae4527aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262787840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787580023.423194:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae4527aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262787840:12345-0@lo:400:kworker.0 Request processed in 54us (8713us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580023.423201:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:0.0:1787580023.423624:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae74f00380 x1874413262788096/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787580039 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787580023.423640:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae74f00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874413262788096:0@lo:400:kworker.0 00010000:00080000:0.0:1787580023.423688:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae6d661f80 x1874413262787840/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787580039 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787580023.423698:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d661f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262787840:0@lo:400:kworker.0 00000100:00100000:0.0:1787580023.925230:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787580023.925255:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fad43127100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874413262788224:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787580023.925334:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580023.925442:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262788224 00000100:00100000:0.0:1787580023.925451:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262788224 00000100:00100000:0.0:1787580023.925502:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787580023.925512:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5f4ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874413262788224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787580023.925552:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787580023.925598:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5f4ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874413262788224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580023.925605:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:0.0:1787580023.925645:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fad43127100 x1874413262788224/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787580039 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787580023.925663:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fad43127100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874413262788224:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787580024.268969:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580024.269017:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580024.269053:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580024.269147:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239681152 00000100:00100000:1.0:1787580024.269158:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239681152 00000100:00100000:1.0:1787580024.269226:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 252 00000100:00100000:1.0:1787580024.269236:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae487dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ff68ada-0c43-4367-93b7-ad31684360cf+13:2361:x1874413239681152:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:1.0:1787580024.269334:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae487dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ff68ada-0c43-4367-93b7-ad31684360cf+13:2361:x1874413239681152:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 99us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580024.269344:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 252 00000100:00100000:2.0:1787580024.276016:0:8897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239681280 00000100:00100000:2.0:1787580024.276031:0:8897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239681280 00000100:00100000:0.0:1787580024.284618:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239681408 00000100:00100000:0.0:1787580024.284637:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239681408 00000100:00100000:0.0:1787580024.284730:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 105 00000100:00100000:0.0:1787580024.284744:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74f01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d66e8ae-0b45-4a46-9f01-8e93d52be8ea+5:2360:x1874413239681408:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:0.0:1787580024.284835:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74f01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d66e8ae-0b45-4a46-9f01-8e93d52be8ea+5:2360:x1874413239681408:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 95us (15780us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580024.284842:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 105 00000100:00080000:1.0:1787580024.285994:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787580024.291451:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 106 00000100:00100000:2.0:1787580024.291469:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74f03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:2361:x1874413239681280:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:2.0:1787580024.291557:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74f03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:2361:x1874413239681280:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 94us (22540us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580024.291565:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 106 00000100:00080000:1.0:1787580024.291640:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787580024.311546:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787580025.331655:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787580026.359645:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787580026.490063:0:11481:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 10:00:24 (1787580024) === 00000100:00100000:3.0:1787580026.776327:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580026.776463:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580026.776933:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239681664 00000100:00100000:1.0:1787580026.776946:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239681664 00000100:00100000:1.0:1787580026.777025:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 0 00000100:00100000:1.0:1787580026.777037:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74f00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:9721:x1874413239681664:12345-192.168.202.36@tcp:700:mkdir.0 00000100:00100000:1.0:1787580026.777135:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74f00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:9721:x1874413239681664:12345-192.168.202.36@tcp:700:mkdir.0 Request processed in 100us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580026.777142:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 0 00000100:00100000:0.0:1787580026.777718:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239681536 00000100:00100000:0.0:1787580026.777725:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239681536 00000100:00100000:0.0:1787580026.777768:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 14 00000100:00100000:0.0:1787580026.777791:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74f03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:2359:x1874413239681536:12345-192.168.202.36@tcp:41:mkdir.0 00000004:00000024:0.0:1787580026.777827:0:5854:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787580026.777913:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74f03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:2359:x1874413239681536:12345-192.168.202.36@tcp:41:mkdir.0 Request processed in 124us (1599us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580026.777921:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 14 00000100:00080000:2.0:1787580026.778412:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787580026.789426:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580026.789646:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239681920 00000100:00100000:2.0:1787580026.789658:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239681920 00000100:00100000:2.0:1787580026.789738:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 15 00000100:00100000:2.0:1787580026.789766:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74f03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:9721:x1874413239681920:12345-192.168.202.36@tcp:36:mkdir.0 00010000:00010000:2.0:1787580026.789830:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787580026.789862:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59000/0xc86deac2083376e6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9cfe1 expref: 6 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580026.789884:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fae5bb2f400) 00010000:00010000:2.0:1787580026.789895:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787580026.790236:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae74ed9200/0xc86deac208337805 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580026.790250:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae74ed9200/0xc86deac208337805 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580026.790260:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae74ed9200/0xc86deac208337805 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580026.790334:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae74ed8800/0xc86deac20833780c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580026.790342:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae74ed8800/0xc86deac20833780c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580026.790349:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae74ed8800/0xc86deac20833780c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787580026.795169:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787580026.795304:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae74ed9200/0xc86deac208337805 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580026.795316:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae74ed9200/0xc86deac208337805 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580026.795336:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae74ed9200/0xc86deac208337805 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580026.795342:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae74ed9200 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:2.0:1787580026.795347:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae74ed9200/0xc86deac208337805 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580026.795364:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae74ed9200/0xc86deac208337805 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580026.795409:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fae4c7d9200) 00010000:00010000:2.0:1787580026.795413:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787580026.795418:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae74ed9200/0xc86deac208337805 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580026.795425:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae74ed9200/0xc86deac208337805 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787580026.795445:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001a49b12b reply state 000000009382b193 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff8fae74ed8800/0xc86deac20833780c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580026.795455:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787580026.795688:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74f03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+7:9721:x1874413239681920:12345-192.168.202.36@tcp:36:mkdir.0 Request processed in 5912us (6304us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1787580026.795697:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 15 00010000:00010000:3.0:1787580026.800913:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae74ed8800/0xc86deac20833780c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580026.800935:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae74ed8800/0xc86deac20833780c lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580026.800944:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae74ed8800/0xc86deac20833780c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580026.800951:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae74ed8800 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:3.0:1787580026.800957:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae74ed8800/0xc86deac20833780c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580026.800965:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae74ed8800/0xc86deac20833780c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580026.800987:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8fae4c7d9b00) 00010000:00010000:3.0:1787580026.801005:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787580026.801012:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae74ed8800/0xc86deac20833780c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580026.801019:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae74ed8800/0xc86deac20833780c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580026.808705:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580026.808895:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239682048 00000100:00100000:0.0:1787580026.808906:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239682048 00000100:00100000:0.0:1787580026.808974:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 16 00000100:00100000:0.0:1787580026.808986:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74f03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:9723:x1874413239682048:12345-192.168.202.36@tcp:101:chmod.0 00010000:00010000:0.0:1787580026.809012:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787580026.809038:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea400/0xc86deac208337813 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d066 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580026.809112:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feac00/0xc86deac20833781a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580026.809125:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feac00/0xc86deac20833781a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580026.809135:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feac00/0xc86deac20833781a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787580026.809212:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1787580026.809218:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787580026.809264:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feac00/0xc86deac20833781a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580026.809291:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea400/0xc86deac208337813 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d066 expref: 8 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580026.809329:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feac00/0xc86deac20833781a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d066 expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580026.809338:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fae56e35a00) 00010000:00010000:0.0:1787580026.809341:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787580026.809344:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae50feac00, rc 0) 00000100:00100000:0.0:1787580026.809465:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74f03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+7:9723:x1874413239682048:12345-192.168.202.36@tcp:101:chmod.0 Request processed in 480us (781us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580026.809472:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 16 00000100:00100000:1.0:1787580026.813939:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580026.814164:0:8897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239682304 00000100:00100000:3.0:1787580026.814346:0:8897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239682304 00000100:00100000:3.0:1787580026.814537:0:8897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 17 00000100:00100000:3.0:1787580026.814549:0:8897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7efd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+7:9723:x1874413239682304:12345-192.168.202.36@tcp:36:chmod.0 00010000:00010000:3.0:1787580026.814605:0:8897:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787580026.814635:0:8897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feac00/0xc86deac20833781a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d066 expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580026.814657:0:8897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fae56e35a00) 00010000:00010000:3.0:1787580026.814672:0:8897:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787580026.814714:0:8897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150ee00/0xc86deac208337821 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580026.814736:0:8897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150ee00/0xc86deac208337821 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580026.814746:0:8897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150ee00/0xc86deac208337821 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787580026.815070:0:8897:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008e626286 reply state 00000000f995843e transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150ee00/0xc86deac208337821 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580026.815081:0:8897:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787580026.815104:0:8897:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1787580026.815221:0:8897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7efd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+8:9723:x1874413239682304:12345-192.168.202.36@tcp:36:chmod.0 Request processed in 673us (1293us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1787580026.815229:0:8897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 17 00010000:00010000:0.0:1787580026.819141:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150ee00/0xc86deac208337821 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580026.819160:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150ee00/0xc86deac208337821 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580026.819168:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150ee00/0xc86deac208337821 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580026.819174:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae4150ee00 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:0.0:1787580026.819189:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150ee00/0xc86deac208337821 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580026.819198:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150ee00/0xc86deac208337821 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580026.819218:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fae530b1100) 00010000:00010000:0.0:1787580026.819221:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787580026.819225:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150ee00/0xc86deac208337821 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580026.819247:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150ee00/0xc86deac208337821 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580026.838059:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580026.838248:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239682432 00000100:00100000:0.0:1787580026.838271:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239682432 00000100:00100000:0.0:1787580026.838345:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 18 00000100:00100000:0.0:1787580026.838370:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7efd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+7:9724:x1874413239682432:12345-192.168.202.36@tcp:101:chown.0 00010000:00010000:0.0:1787580026.838420:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787580026.838444:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea400/0xc86deac208337828 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d06d expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580026.838510:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea000/0xc86deac20833782f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580026.838523:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea000/0xc86deac20833782f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580026.838534:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea000/0xc86deac20833782f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787580026.838733:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1787580026.838738:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787580026.838785:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea000/0xc86deac20833782f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580026.838811:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea400/0xc86deac208337828 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d06d expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580026.838830:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea000/0xc86deac20833782f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d06d expref: 8 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580026.838853:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fae56e35500) 00010000:00010000:0.0:1787580026.838856:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787580026.838860:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae50fea000, rc 0) 00000100:00100000:0.0:1787580026.838931:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7efd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+8:9724:x1874413239682432:12345-192.168.202.36@tcp:101:chown.0 Request processed in 576us (884us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580026.838938:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 18 00000100:00100000:3.0:1787580026.841572:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580026.841680:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239682560 00000100:00100000:0.0:1787580026.841690:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239682560 00000100:00100000:0.0:1787580026.841755:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 19 00000100:00100000:0.0:1787580026.841765:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74f01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+8:9724:x1874413239682560:12345-192.168.202.36@tcp:101:chown.0 00010000:00010000:0.0:1787580026.841784:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787580026.841801:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb200/0xc86deac208337836 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d074 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580026.841856:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feae00/0xc86deac20833783d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580026.841869:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feae00/0xc86deac20833783d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580026.841879:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feae00/0xc86deac20833783d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580026.841893:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac208337844 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580026.841899:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac208337844 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580026.841923:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac208337844 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580026.842021:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feaa00/0xc86deac20833784b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580026.842029:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feaa00/0xc86deac20833784b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580026.842035:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feaa00/0xc86deac20833784b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787580026.842065:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:0.0:1787580026.842068:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787580026.842086:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feaa00/0xc86deac20833784b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580026.842097:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feae00/0xc86deac20833783d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580026.842104:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feae00/0xc86deac20833783d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580026.842110:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feae00/0xc86deac20833783d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580026.842116:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae50feae00 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:0.0:1787580026.842121:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feae00/0xc86deac20833783d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580026.842128:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feae00/0xc86deac20833783d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580026.842144:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fae56e35500) 00010000:00010000:0.0:1787580026.842147:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787580026.842151:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feae00/0xc86deac20833783d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580026.842157:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feae00/0xc86deac20833783d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580026.842170:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac208337844 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580026.842175:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac208337844 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580026.842181:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac208337844 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580026.842186:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae50feb600 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:0.0:1787580026.842189:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac208337844 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580026.842194:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac208337844 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580026.842200:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8fae56e35b00) 00010000:00010000:0.0:1787580026.842203:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787580026.842205:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac208337844 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580026.842211:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac208337844 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580026.842250:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb200/0xc86deac208337836 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d074 expref: 10 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580026.842278:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feaa00/0xc86deac20833784b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d074 expref: 9 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580026.842286:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8fae56e35c00) 00010000:00010000:0.0:1787580026.842288:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787580026.842291:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae50feaa00, rc 0) 00000100:00100000:0.0:1787580026.842336:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74f01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+9:9724:x1874413239682560:12345-192.168.202.36@tcp:101:chown.0 Request processed in 572us (772us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580026.842343:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 19 00000100:00100000:3.0:1787580026.845721:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580026.845829:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239682816 00000100:00100000:1.0:1787580026.845840:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239682816 00000100:00100000:1.0:1787580026.845894:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 20 00000100:00100000:1.0:1787580026.845904:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74f02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+9:9724:x1874413239682816:12345-192.168.202.36@tcp:36:chown.0 00010000:00010000:1.0:1787580026.845952:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787580026.845977:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feaa00/0xc86deac20833784b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d074 expref: 9 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580026.845997:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8fae56e35c00) 00010000:00010000:1.0:1787580026.846006:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787580026.846028:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac208337852 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580026.846053:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac208337852 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580026.846062:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac208337852 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787580026.875473:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:1.0:1787580026.875824:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fb913801 reply state 000000004924f22d transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac208337852 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580026.875839:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1787580026.876023:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:1.0:1787580026.876171:0:5853:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1787580026.876351:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74f02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+7:9724:x1874413239682816:12345-192.168.202.36@tcp:36:chown.0 Request processed in 30442us (30636us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1787580026.876371:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 20 00010000:00010000:2.0:1787580026.885221:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac208337852 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580026.885240:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac208337852 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580026.885266:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac208337852 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580026.885273:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae4ca59200 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:2.0:1787580026.885289:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac208337852 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580026.885298:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac208337852 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580026.885316:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8fae5bb2f600) 00010000:00010000:2.0:1787580026.885319:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787580026.885325:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac208337852 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580026.885331:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac208337852 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580026.888915:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580026.888991:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239682944 00000100:00100000:0.0:1787580026.889002:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239682944 00000100:00100000:0.0:1787580026.889059:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 21 00000100:00100000:0.0:1787580026.889069:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74f02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:9725:x1874413239682944:12345-192.168.202.36@tcp:101:touch.500 00010000:00010000:0.0:1787580026.889094:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787580026.889115:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb200/0xc86deac208337859 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d07b expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787580026.890703:0:5852:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1537us 00010000:00010000:2.0:1787580026.906271:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae74ed9200/0xc86deac208337860 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580026.906535:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae74ed9200/0xc86deac208337860 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580026.906546:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae74ed9200/0xc86deac208337860 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580026.906564:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae74ed9e00/0xc86deac208337867 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580026.906583:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae74ed9e00/0xc86deac208337867 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580026.906589:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae74ed9e00/0xc86deac208337867 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580026.907040:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae74ed9600/0xc86deac20833786e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580026.907050:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae74ed9600/0xc86deac20833786e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580026.907058:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae74ed9600/0xc86deac20833786e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787580026.907136:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787580026.907141:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787580026.907447:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fae74ed9600/0xc86deac20833786e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580026.907462:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae74ed9200/0xc86deac208337860 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580026.907469:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae74ed9200/0xc86deac208337860 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580026.907476:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae74ed9200/0xc86deac208337860 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580026.907483:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae74ed9200 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:2.0:1787580026.907487:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae74ed9200/0xc86deac208337860 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580026.907502:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae74ed9200/0xc86deac208337860 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580026.907514:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fae56e35500) 00010000:00010000:2.0:1787580026.907516:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787580026.907522:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae74ed9200/0xc86deac208337860 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580026.907527:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae74ed9200/0xc86deac208337860 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580026.907540:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae74ed9e00/0xc86deac208337867 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580026.907546:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae74ed9e00/0xc86deac208337867 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580026.907551:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae74ed9e00/0xc86deac208337867 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580026.907556:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae74ed9e00 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:2.0:1787580026.907558:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae74ed9e00/0xc86deac208337867 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580026.907564:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae74ed9e00/0xc86deac208337867 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580026.907570:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8fae4c7d9c00) 00010000:00010000:2.0:1787580026.907573:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787580026.907575:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae74ed9e00/0xc86deac208337867 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580026.907591:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae74ed9e00/0xc86deac208337867 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580026.907631:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb200/0xc86deac208337859 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d07b expref: 8 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580026.907645:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae74ed9600/0xc86deac20833786e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d07b expref: 7 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580026.907652:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8fae4c7d9200) 00010000:00010000:2.0:1787580026.907654:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787580026.907657:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae74ed9600, rc 0) 00000100:00100000:2.0:1787580026.907786:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74f02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+7:9725:x1874413239682944:12345-192.168.202.36@tcp:101:touch.500 Request processed in 18716us (18880us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580026.907797:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 21 00000100:00100000:1.0:1787580026.912057:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580026.912379:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239683200 00000100:00100000:0.0:1787580026.917498:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239683200 00000100:00100000:0.0:1787580026.917593:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 22 00000100:00100000:0.0:1787580026.917605:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7efdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+7:9725:x1874413239683200:12345-192.168.202.36@tcp:101:touch.500 00010000:00010000:0.0:1787580026.917628:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787580026.917650:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac208337875 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d082 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580026.917977:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feae00/0xc86deac20833787c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580026.917993:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feae00/0xc86deac20833787c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580026.918004:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feae00/0xc86deac20833787c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580026.918068:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea400/0xc86deac208337883 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x90211c3a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580026.918076:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea400/0xc86deac208337883 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x90211c3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580026.918083:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea400/0xc86deac208337883 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x90211c3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787580026.919576:0:5854:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:0.0:1787580026.919869:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb800/0xc86deac20833788a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580026.919883:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb800/0xc86deac20833788a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580026.919891:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb800/0xc86deac20833788a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580026.919926:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feae00/0xc86deac20833787c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580026.919942:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feae00/0xc86deac20833787c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580026.919948:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feae00/0xc86deac20833787c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580026.919954:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae50feae00 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:0.0:1787580026.919959:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feae00/0xc86deac20833787c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580026.919966:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feae00/0xc86deac20833787c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580026.919979:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8fae4c7d9200) 00010000:00010000:0.0:1787580026.919982:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787580026.919987:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feae00/0xc86deac20833787c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580026.919993:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feae00/0xc86deac20833787c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787580026.920008:0:5854:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000062ee1515 reply state 0000000014d63566 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea400/0xc86deac208337883 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x90211c3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580026.920016:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787580026.920051:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac208337875 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d082 expref: 10 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580026.920065:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb800/0xc86deac20833788a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d082 expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580026.920083:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8fae56e35600) 00010000:00010000:0.0:1787580026.920086:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787580026.920088:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae50feb800, rc 0) 00000100:00100000:0.0:1787580026.920296:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7efdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+10:9725:x1874413239683200:12345-192.168.202.36@tcp:101:touch.500 Request processed in 2691us (8246us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1787580026.920305:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 22 00010000:00010000:0.0:1787580026.925692:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea400/0xc86deac208337883 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x90211c3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580026.925710:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea400/0xc86deac208337883 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x90211c3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580026.925718:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea400/0xc86deac208337883 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x90211c3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580026.925725:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae50fea400 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:0.0:1787580026.925730:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea400/0xc86deac208337883 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x90211c3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580026.925737:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea400/0xc86deac208337883 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x90211c3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580026.925754:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x90211c3a (ffff8fae56e35b00) 00010000:00010000:0.0:1787580026.925758:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787580026.925763:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea400/0xc86deac208337883 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x90211c3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580026.925769:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea400/0xc86deac208337883 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x90211c3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580026.928163:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580026.928436:0:8897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239683456 00000100:00100000:3.0:1787580026.928446:0:8897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239683456 00000100:00100000:3.0:1787580026.928500:0:8897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 23 00000100:00100000:3.0:1787580026.928511:0:8897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7efd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+9:9725:x1874413239683456:12345-192.168.202.36@tcp:36:touch.500 00010000:00010000:3.0:1787580026.928568:0:8897:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787580026.928594:0:8897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb800/0xc86deac20833788a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d082 expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580026.928611:0:8897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8fae56e35600) 00010000:00010000:3.0:1787580026.928622:0:8897:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787580026.928666:0:8897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150fe00/0xc86deac208337898 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580026.928678:0:8897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150fe00/0xc86deac208337898 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580026.928687:0:8897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150fe00/0xc86deac208337898 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787580026.928837:0:8897:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ad780d3d reply state 000000001519010d transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150fe00/0xc86deac208337898 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580026.928862:0:8897:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787580026.928957:0:8897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7efd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+10:9725:x1874413239683456:12345-192.168.202.36@tcp:36:touch.500 Request processed in 447us (806us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1787580026.928964:0:8897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 23 00010000:00010000:2.0:1787580026.932566:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150fe00/0xc86deac208337898 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580026.932585:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150fe00/0xc86deac208337898 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580026.932592:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150fe00/0xc86deac208337898 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580026.932597:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae4150fe00 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:2.0:1787580026.932602:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150fe00/0xc86deac208337898 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580026.932609:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150fe00/0xc86deac208337898 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580026.932640:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8fae530b1500) 00010000:00010000:2.0:1787580026.932643:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787580026.932647:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150fe00/0xc86deac208337898 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580026.932652:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150fe00/0xc86deac208337898 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580026.934091:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580026.934160:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239683584 00000100:00100000:2.0:1787580026.934168:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239683584 00000100:00100000:2.0:1787580026.934232:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 24 00000100:00100000:2.0:1787580026.934242:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7efdbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+9:9725:x1874413239683584:12345-192.168.202.36@tcp:101:touch.500 00010000:00010000:2.0:1787580026.934269:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787580026.934298:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae74ed9e00/0xc86deac20833789f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d089 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580026.934368:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae74ed9e00/0xc86deac20833789f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d089 expref: 10 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580026.934427:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae74ed9e00/0xc86deac20833789f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d089 expref: 10 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580026.934449:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8fae4c7d9c00) 00010000:00010000:2.0:1787580026.934452:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787580026.934455:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae74ed9e00, rc 0) 00000100:00100000:2.0:1787580026.934517:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7efdbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+10:9725:x1874413239683584:12345-192.168.202.36@tcp:101:touch.500 Request processed in 276us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580026.934524:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 24 00000100:00100000:3.0:1787580026.937786:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580026.937872:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239683712 00000100:00100000:2.0:1787580026.937881:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239683712 00000100:00100000:2.0:1787580026.937931:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 16 00000100:00100000:2.0:1787580026.937939:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74f01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2357:x1874413239683712:12345-192.168.202.36@tcp:8:touch.500 00010000:00080000:2.0:1787580026.937972:0:6707:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 31d1df27-21ab-4c76-bd19-e53fa778bd7e@192.168.202.36@tcp t0 exp 0000000000000000 cur 374 last 0 00000020:00000080:2.0:1787580026.938016:0:6707:0:(genops.c:1385:class_connect()) connect: client 31d1df27-21ab-4c76-bd19-e53fa778bd7e, cookie 0xc86deac2083378a6 00002000:00100000:2.0:1787580026.938031:0:6707:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 31d1df27-21ab-4c76-bd19-e53fa778bd7e/ffff8fae5ff35800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787580026.938055:0:6707:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787580026.938301:0:6707:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787580026.938329:0:6707:0:(import.c:65:import_set_state_nolock()) ffff8fae5ff33000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787580026.938464:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74f01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:2357:x1874413239683712:12345-192.168.202.36@tcp:8:touch.500 Request processed in 523us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580026.938473:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 16 00000100:00100000:1.0:1787580026.942648:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580026.942761:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239683840 00000100:00100000:0.0:1787580026.942772:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239683840 00000100:00100000:0.0:1787580026.942847:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 17 00000100:00100000:0.0:1787580026.942859:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7efd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:0:x1874413239683840:12345-192.168.202.36@tcp:2:touch.500 00000100:00080000:2.0:1787580026.943475:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1787580026.975725:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:3.0:1787580026.975744:0:7653:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 31d1df27-21ab-4c76-bd19-e53fa778bd7e 00000100:00100000:0.0:1787580026.975920:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7efd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+5:0:x1874413239683840:12345-192.168.202.36@tcp:2:touch.500 Request processed in 33058us (33281us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1787580026.975930:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 17 00000100:00100000:1.0:1787580026.977950:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580026.978008:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239684096 00000100:00100000:3.0:1787580026.978018:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239684096 00000100:00100000:3.0:1787580026.978073:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 2 00000100:00100000:3.0:1787580026.978083:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7efdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+10:9725:x1874413239684096:12345-192.168.202.36@tcp:35:touch.500 00000100:00100000:3.0:1787580026.978437:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7efdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+11:9725:x1874413239684096:12345-192.168.202.36@tcp:35:touch.500 Request processed in 354us (496us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1787580026.978445:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 2 00000100:00100000:3.0:1787580026.985850:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580026.986008:0:8897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239684224 00000100:00100000:2.0:1787580026.986019:0:8897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239684224 00000100:00100000:2.0:1787580026.986085:0:8897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 25 00000100:00100000:2.0:1787580026.986096:0:8897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74f01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+11:9726:x1874413239684224:12345-192.168.202.36@tcp:101:rm.0 00010000:00010000:2.0:1787580026.986122:0:8897:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787580026.986140:0:8897:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae74ed9200/0xc86deac2083378ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d090 expref: -99 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580026.986214:0:8897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae74ed8800/0xc86deac2083378b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580026.986229:0:8897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae74ed8800/0xc86deac2083378b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580026.986258:0:8897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae74ed8800/0xc86deac2083378b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787580026.986317:0:8897:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787580026.986321:0:8897:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787580026.986372:0:8897:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fae74ed8800/0xc86deac2083378b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580026.986443:0:8897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae74ed9200/0xc86deac2083378ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d090 expref: 13 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580026.986464:0:8897:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae74ed8800/0xc86deac2083378b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d090 expref: 12 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580026.986473:0:8897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8fae4c7d9200) 00010000:00010000:2.0:1787580026.986476:0:8897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787580026.986480:0:8897:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae74ed8800, rc 0) 00000100:00100000:2.0:1787580026.986538:0:8897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74f01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+12:9726:x1874413239684224:12345-192.168.202.36@tcp:101:rm.0 Request processed in 443us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580026.986546:0:8897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 25 00000100:00100000:1.0:1787580026.990716:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580026.990791:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239684480 00000100:00100000:2.0:1787580026.990800:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239684480 00000100:00100000:2.0:1787580026.990849:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 26 00000100:00100000:2.0:1787580026.990857:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7efdb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+12:9726:x1874413239684480:12345-192.168.202.36@tcp:101:rm.0 00010000:00010000:2.0:1787580026.990875:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787580026.990891:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae74ed8000/0xc86deac2083378bb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d097 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787580026.991012:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1787580026.991172:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae74ed8000/0xc86deac2083378bb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d097 expref: 14 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580026.991196:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fae56e35500) 00010000:00010000:2.0:1787580026.991199:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787580026.991204:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae74ed8000/0xc86deac2083378bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d097 expref: 14 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580026.991218:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae74ed8000, rc 0) 00000100:00100000:2.0:1787580026.991301:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7efdb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+13:9726:x1874413239684480:12345-192.168.202.36@tcp:101:rm.0 Request processed in 443us (593us total) trans 4294967303 rc 301/301 00000100:00100000:2.0:1787580026.991309:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 26 00000100:00100000:1.0:1787580026.995503:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580026.995843:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239684608 00000100:00100000:3.0:1787580026.995852:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239684608 00000100:00100000:3.0:1787580026.995914:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 3 00000100:00100000:3.0:1787580026.995925:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7efd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+13:9726:x1874413239684608:12345-192.168.202.36@tcp:37:rm.0 00000100:00100000:2.0:1787580027.000146:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7efd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+13:9726:x1874413239684608:12345-192.168.202.36@tcp:37:rm.0 Request processed in 4212us (4641us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580027.000161:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 3 00000100:00100000:1.0:1787580027.006301:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580027.006467:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239684864 00000100:00100000:0.0:1787580027.006478:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239684864 00000100:00100000:0.0:1787580027.006536:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 4 00000100:00100000:0.0:1787580027.006548:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51884c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+13:9726:x1874413239684864:12345-192.168.202.36@tcp:35:rm.0 00000100:00100000:0.0:1787580027.006839:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51884c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+14:9726:x1874413239684864:12345-192.168.202.36@tcp:35:rm.0 Request processed in 292us (549us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1787580027.006848:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 4 00000100:00100000:1.0:1787580027.012654:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580027.012834:0:8897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239685120 00000100:00100000:2.0:1787580027.012844:0:8897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239685120 00000100:00100000:2.0:1787580027.012899:0:8897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 27 00000100:00100000:2.0:1787580027.012909:0:8897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7efdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+14:9726:x1874413239685120:12345-192.168.202.36@tcp:101:rm.0 00010000:00010000:2.0:1787580027.012932:0:8897:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787580027.012952:0:8897:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae74ed8000/0xc86deac2083378c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d09e expref: -99 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.013060:0:8897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae74ed9200/0xc86deac2083378d0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.013084:0:8897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae74ed9200/0xc86deac2083378d0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.013095:0:8897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae74ed9200/0xc86deac2083378d0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787580027.013105:0:8897:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1787580027.013225:0:8897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae74ed8000/0xc86deac2083378c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d09e expref: 17 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.013245:0:8897:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae74ed9200/0xc86deac2083378d0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d09e expref: 16 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.013253:0:8897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8fae4c7d9200) 00010000:00010000:2.0:1787580027.013256:0:8897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787580027.013260:0:8897:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae74ed9200, rc 0) 00000100:00100000:2.0:1787580027.013331:0:8897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7efdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+16:9726:x1874413239685120:12345-192.168.202.36@tcp:101:rm.0 Request processed in 423us (686us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1787580027.013338:0:8897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 27 00000100:00100000:3.0:1787580027.017190:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580027.017288:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239685248 00000100:00100000:2.0:1787580027.017300:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239685248 00000100:00100000:2.0:1787580027.017369:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 28 00000100:00100000:2.0:1787580027.017379:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74f02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+16:9726:x1874413239685248:12345-192.168.202.36@tcp:41:rm.0 00000004:00000024:2.0:1787580027.017486:0:5853:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:2.0:1787580027.017549:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74f02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+16:9726:x1874413239685248:12345-192.168.202.36@tcp:41:rm.0 Request processed in 171us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580027.017558:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 28 00000100:00100000:1.0:1787580027.021833:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580027.021921:0:8897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239685376 00000100:00100000:2.0:1787580027.021932:0:8897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239685376 00000100:00100000:2.0:1787580027.021999:0:8897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 29 00000100:00100000:2.0:1787580027.022011:0:8897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7efda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+16:9726:x1874413239685376:12345-192.168.202.36@tcp:101:rm.0 00010000:00010000:2.0:1787580027.022035:0:8897:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787580027.022056:0:8897:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae74ed8600/0xc86deac2083378de lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d0a5 expref: -99 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.022122:0:8897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae74ed9c00/0xc86deac2083378e5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.022136:0:8897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae74ed9c00/0xc86deac2083378e5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.022147:0:8897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae74ed9c00/0xc86deac2083378e5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.022192:0:8897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9200/0xc86deac2083378ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x90211c3a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.022201:0:8897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9200/0xc86deac2083378ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x90211c3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.022208:0:8897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9200/0xc86deac2083378ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x90211c3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.022329:0:8897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8c00/0xc86deac2083378f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.022337:0:8897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8c00/0xc86deac2083378f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.022362:0:8897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8c00/0xc86deac2083378f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787580027.022430:0:8897:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787580027.022435:0:8897:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787580027.022451:0:8897:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8c00/0xc86deac2083378f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.022462:0:8897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8c00/0xc86deac2083378f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.022469:0:8897:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae74ed9c00/0xc86deac2083378e5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.022475:0:8897:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae74ed9c00/0xc86deac2083378e5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.022482:0:8897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae74ed9c00/0xc86deac2083378e5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.022488:0:8897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae74ed9c00 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:2.0:1787580027.022492:0:8897:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae74ed9c00/0xc86deac2083378e5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.022500:0:8897:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae74ed9c00/0xc86deac2083378e5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.022511:0:8897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8fae4c7d9200) 00010000:00010000:2.0:1787580027.022514:0:8897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787580027.022517:0:8897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae74ed9c00/0xc86deac2083378e5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.022533:0:8897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae74ed9c00/0xc86deac2083378e5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.022546:0:8897:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9200/0xc86deac2083378ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x90211c3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.022552:0:8897:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9200/0xc86deac2083378ec lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x90211c3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.022557:0:8897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9200/0xc86deac2083378ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x90211c3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.022562:0:8897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db9200 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:2.0:1787580027.022565:0:8897:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9200/0xc86deac2083378ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x90211c3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.022570:0:8897:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9200/0xc86deac2083378ec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x90211c3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.022578:0:8897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x90211c3a (ffff8fae4c7d9700) 00010000:00010000:2.0:1787580027.022580:0:8897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787580027.022584:0:8897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9200/0xc86deac2083378ec lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x90211c3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.022590:0:8897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9200/0xc86deac2083378ec lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x90211c3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.022627:0:8897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae74ed8600/0xc86deac2083378de lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d0a5 expref: 18 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.022640:0:8897:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8c00/0xc86deac2083378f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d0a5 expref: 17 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.022652:0:8897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8fae4c7d9c00) 00010000:00010000:2.0:1787580027.022654:0:8897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787580027.022657:0:8897:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae48db8c00, rc 0) 00000100:00100000:2.0:1787580027.022716:0:8897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7efda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+17:9726:x1874413239685376:12345-192.168.202.36@tcp:101:rm.0 Request processed in 707us (894us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580027.022723:0:8897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 29 00000100:00100000:1.0:1787580027.026058:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580027.026163:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239685632 00000100:00100000:2.0:1787580027.026230:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239685632 00000100:00100000:2.0:1787580027.026428:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 30 00000100:00100000:2.0:1787580027.026441:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7efd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+17:9726:x1874413239685632:12345-192.168.202.36@tcp:36:rm.0 00010000:00010000:2.0:1787580027.026497:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787580027.026525:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8c00/0xc86deac2083378f3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d0a5 expref: 17 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.026546:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae74ed9e00/0xc86deac20833789f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d089 expref: 16 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.026558:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8fae4c7d9c00) 00010000:00010000:2.0:1787580027.026576:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae74ed8800/0xc86deac2083378b4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d090 expref: 15 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.026586:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8fae4c7d9200) 00010000:00010000:2.0:1787580027.026590:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787580027.026610:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac2083378fa lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.026645:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac2083378fa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.026656:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac2083378fa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.026672:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac208337901 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x90211c3a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.026680:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac208337901 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x90211c3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.026687:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac208337901 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x90211c3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.026928:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9600/0xc86deac208337908 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.026936:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9600/0xc86deac208337908 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.026943:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9600/0xc86deac208337908 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787580027.028017:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1787580027.028032:0:5853:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 374783647293ns, next at 375783644346ns, rc = 0 00010000:00010000:2.0:1787580027.028101:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac20833790f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.028115:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac20833790f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.028137:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac20833790f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.028147:0:5853:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac20833790f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.028154:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac20833790f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.028161:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac20833790f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.030430:0:5853:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787580027.030470:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9600/0xc86deac208337908 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.030480:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9600/0xc86deac208337908 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.030488:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9600/0xc86deac208337908 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.030493:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db9600 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:2.0:1787580027.030497:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9600/0xc86deac208337908 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.030504:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9600/0xc86deac208337908 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.030519:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8fae4c7d9800) 00010000:00010000:2.0:1787580027.030521:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787580027.030538:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9600/0xc86deac208337908 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.030545:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9600/0xc86deac208337908 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.030565:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac2083378fa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.030571:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac2083378fa lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.030577:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac2083378fa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.030582:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db8800 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:2.0:1787580027.030584:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac2083378fa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.030590:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac2083378fa lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.030597:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8fae4c7d9200) 00010000:00010000:2.0:1787580027.030599:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787580027.030601:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac2083378fa lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.030606:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac2083378fa lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787580027.030615:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000097ce803f reply state 000000008685bd71 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac208337901 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x90211c3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580027.030631:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787580027.030717:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7efd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+16:9726:x1874413239685632:12345-192.168.202.36@tcp:36:rm.0 Request processed in 4276us (4666us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1787580027.030726:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 30 00010000:00010000:3.0:1787580027.033310:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787580027.033323:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac20833790f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580027.033334:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db9c00 already unused, calling callback (ffffffffc155a230) 00010000:00010000:3.0:1787580027.033338:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac20833790f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580027.033369:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac20833790f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.033619:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac208337901 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x90211c3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.033627:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac208337901 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x90211c3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.033633:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac208337901 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x90211c3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.033638:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db9e00 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:2.0:1787580027.033642:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac208337901 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x90211c3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.033648:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac208337901 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x90211c3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.033661:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x90211c3a (ffff8fae4c7d9500) 00010000:00010000:2.0:1787580027.033664:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787580027.033668:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac208337901 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x90211c3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.033674:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac208337901 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x90211c3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580027.033796:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8fae4c7d9800) 00010000:00010000:3.0:1787580027.033799:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787580027.033803:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac20833790f lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580027.033809:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac20833790f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580027.033823:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787580027.033825:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787580027.033827:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787580027.035271:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580027.036025:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239685888 00000100:00100000:0.0:1787580027.036036:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239685888 00000100:00100000:0.0:1787580027.036136:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 5 00000100:00100000:0.0:1787580027.036148:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7efdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+15:9726:x1874413239685888:12345-192.168.202.36@tcp:35:rm.0 00000100:00100000:0.0:1787580027.036551:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7efdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+16:9726:x1874413239685888:12345-192.168.202.36@tcp:35:rm.0 Request processed in 404us (1287us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1787580027.036559:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 5 00000100:00100000:0.0:1787580027.039299:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580027.039722:0:8897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239686144 00000100:00100000:2.0:1787580027.039741:0:8897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239686144 00000100:00100000:2.0:1787580027.039814:0:8897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 31 00000100:00100000:2.0:1787580027.039825:0:8897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7f5b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+16:9726:x1874413239686144:12345-192.168.202.36@tcp:36:rm.0 00010000:00010000:2.0:1787580027.039884:0:8897:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787580027.039912:0:8897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae74ed9200/0xc86deac2083378d0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d09e expref: 16 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.039934:0:8897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae74ed9600/0xc86deac20833786e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d07b expref: 15 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.039944:0:8897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8fae4c7d9200) 00010000:00010000:2.0:1787580027.039960:0:8897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea000/0xc86deac20833782f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d06d expref: 14 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.039970:0:8897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fae56e35500) 00010000:00010000:2.0:1787580027.039976:0:8897:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787580027.040000:0:8897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac208337916 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.040012:0:8897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac208337916 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.040022:0:8897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac208337916 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.040033:0:8897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac20833791d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.040039:0:8897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac20833791d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.040056:0:8897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac20833791d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.040608:0:8897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9600/0xc86deac208337924 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.040618:0:8897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9600/0xc86deac208337924 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.040626:0:8897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9600/0xc86deac208337924 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787580027.044855:0:8897:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1787580027.044889:0:8897:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9600/0xc86deac208337924 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.044904:0:8897:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9600/0xc86deac208337924 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.044913:0:8897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9600/0xc86deac208337924 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.044919:0:8897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db9600 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:2.0:1787580027.044924:0:8897:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9600/0xc86deac208337924 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.044932:0:8897:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9600/0xc86deac208337924 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.044950:0:8897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8fae4c7d9700) 00010000:00010000:2.0:1787580027.044954:0:8897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787580027.044979:0:8897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9600/0xc86deac208337924 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.044985:0:8897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9600/0xc86deac208337924 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.045020:0:8897:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac208337916 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.045027:0:8897:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac208337916 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.045034:0:8897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac208337916 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.045039:0:8897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db9e00 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:2.0:1787580027.045042:0:8897:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac208337916 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.045048:0:8897:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac208337916 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.045055:0:8897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fae4c7d9500) 00010000:00010000:2.0:1787580027.045057:0:8897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787580027.045060:0:8897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac208337916 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.045065:0:8897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac208337916 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787580027.045077:0:8897:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f9219fbb reply state 00000000b3bca7b4 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac20833791d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580027.045097:0:8897:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787580027.046965:0:8897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7f5b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+15:9726:x1874413239686144:12345-192.168.202.36@tcp:36:rm.0 Request processed in 7129us (7662us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1787580027.046979:0:8897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 31 00010000:00010000:2.0:1787580027.055847:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac20833791d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.055868:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac20833791d lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.055877:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac20833791d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.055883:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db8800 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:2.0:1787580027.055889:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac20833791d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.055897:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac20833791d lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.055914:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8fae4c7d9c00) 00010000:00010000:2.0:1787580027.055918:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787580027.055923:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac20833791d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580027.055929:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac20833791d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580027.379552:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787580028.029412:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787580028.029437:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae74f02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874413262788352:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787580028.029526:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580028.029737:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262788352 00000100:00100000:0.0:1787580028.029750:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262788352 00000100:00100000:0.0:1787580028.029823:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787580028.029834:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874413262788352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787580028.029869:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787580028.029924:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874413262788352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580028.029932:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:2.0:1787580028.029941:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787580028.030084:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae74f02300 x1874413262788352/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787580044 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787580028.030105:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae74f02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874413262788352:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787580028.410936:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787580028.532568:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae779ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262788864:0@lo:400:kworker.0 00000100:00100000:2.0:1787580028.532640:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787580028.532697:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787580028.532705:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae779aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3316:1874413262788480:0@lo:400:kworker.0 00000100:00100000:2.0:1787580028.532733:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787580028.532758:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae779ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1874413262788992:0@lo:400:kworker.0 00000100:00100000:2.0:1787580028.532782:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787580028.532813:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae779ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874413262788608:0@lo:400:kworker.0 00000100:00100000:2.0:1787580028.532837:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787580028.532855:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae779ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874413262789120:0@lo:400:kworker.0 00000100:00100000:2.0:1787580028.532876:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787580028.532895:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787580028.532900:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae779ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874413262788736:0@lo:400:kworker.0 00000100:00100000:2.0:1787580028.532922:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787580028.532952:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262788864 00000100:00100000:2.0:1787580028.532959:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262788864 00000100:00100000:2.0:1787580028.533009:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262789120 00000100:00100000:2.0:1787580028.533013:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262789120 00000100:00100000:2.0:1787580028.533045:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787580028.533055:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262788864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787580028.533108:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262788864:12345-0@lo:400:kworker.0 Request processed in 53us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580028.533114:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787580028.533139:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787580028.533144:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874413262789120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787580028.533197:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874413262789120:12345-0@lo:400:kworker.0 Request processed in 53us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580028.533204:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787580028.533220:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262788480 00000100:00100000:2.0:1787580028.533223:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262788480 00000100:00100000:2.0:1787580028.533246:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1787580028.533252:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae487dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:3316:x1874413262788480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787580028.533280:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae487dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:3316:x1874413262788480:12345-0@lo:400:kworker.0 Request processed in 29us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580028.533285:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1787580028.533311:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262788992 00000100:00100000:2.0:1787580028.533315:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262788992 00000100:00100000:2.0:1787580028.533337:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262788608 00000100:00100000:2.0:1787580028.533352:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262788608 00000100:00100000:2.0:1787580028.533363:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262788736 00000100:00100000:2.0:1787580028.533365:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262788736 00000100:00100000:2.0:1787580028.533378:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787580028.533407:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874413262788992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787580028.533437:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874413262788992:12345-0@lo:400:kworker.0 Request processed in 54us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580028.533443:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787580028.533454:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787580028.533460:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874413262788608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787580028.533484:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874413262788608:12345-0@lo:400:kworker.0 Request processed in 25us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580028.533499:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787580028.533511:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787580028.533517:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874413262788736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787580028.533547:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874413262788736:12345-0@lo:400:kworker.0 Request processed in 31us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580028.533553:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:2.0:1787580028.533578:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787580028.533583:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787580028.533620:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae779ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874413262788736:0@lo:400:kworker.0 00000100:00100000:2.0:1787580028.533631:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae779ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874413262788608:0@lo:400:kworker.0 00010000:00080000:2.0:1787580028.533643:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae779ad880 x1874413262789120/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787580044 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787580028.533653:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae779ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874413262789120:0@lo:400:kworker.0 00000100:00100000:2.0:1787580028.533685:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae779aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3316:1874413262788480:0@lo:400:kworker.0 00000100:00100000:2.0:1787580028.533695:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae779ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1874413262788992:0@lo:400:kworker.0 00010000:00080000:2.0:1787580028.533704:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae779ace00 x1874413262788864/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787580044 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787580028.533713:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae779ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262788864:0@lo:400:kworker.0 00000004:00080000:1.0:1787580029.044049:0:8001:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 376799662335ns, next at 377799659168ns, rc = 0 00000100:00100000:1.0:1787580029.044093:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787580029.044116:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7efd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874413262789248:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787580029.044189:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787580029.044259:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262789248 00000100:00100000:1.0:1787580029.044267:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262789248 00000100:00100000:1.0:1787580029.044313:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787580029.044323:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7efd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874413262789248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787580029.044376:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787580029.044691:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7efd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874413262789248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 369us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580029.044699:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:0.0:1787580029.049408:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae7efd9180 x1874413262789248/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787580045 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787580029.049437:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7efd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874413262789248:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787580029.397004:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580029.397061:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580029.397096:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580029.397153:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580029.397205:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239686400 00000100:00100000:0.0:1787580029.397218:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239686400 00000100:00100000:0.0:1787580029.397278:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239686656 00000100:00100000:0.0:1787580029.397282:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239686656 00000100:00100000:0.0:1787580029.397303:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 110 00000100:00100000:0.0:1787580029.397313:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7e97e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+14:2359:x1874413239686400:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:0.0:1787580029.397524:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7e97e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+14:2359:x1874413239686400:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 210us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580029.397532:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 110 00000100:00100000:0.0:1787580029.397564:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 111 00000100:00100000:0.0:1787580029.397570:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7e97f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d66e8ae-0b45-4a46-9f01-8e93d52be8ea+5:2359:x1874413239686656:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:0.0:1787580029.397600:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7e97f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d66e8ae-0b45-4a46-9f01-8e93d52be8ea+5:2359:x1874413239686656:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 30us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580029.397605:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 111 00000100:00080000:0.0:1787580029.397622:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787580029.397926:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239686528 00000100:00100000:2.0:1787580029.397932:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239686528 00000100:00100000:2.0:1787580029.397982:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 53 00000100:00100000:2.0:1787580029.397990:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fad43127100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+5:2359:x1874413239686528:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:2.0:1787580029.398032:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fad43127100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+5:2359:x1874413239686528:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 42us (971us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580029.398038:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 53 00000100:00080000:3.0:1787580029.398103:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787580029.398470:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239686272 00000100:00100000:1.0:1787580029.398475:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239686272 00000100:00100000:1.0:1787580029.398514:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 254 00000100:00100000:1.0:1787580029.398522:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae52127450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ff68ada-0c43-4367-93b7-ad31684360cf+13:2359:x1874413239686272:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:1.0:1787580029.398566:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae52127450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ff68ada-0c43-4367-93b7-ad31684360cf+13:2359:x1874413239686272:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 44us (1575us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580029.398572:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 254 00010000:00010000:2.0:1787580029.428298:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787580030.452107:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787580031.485848:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787580031.888103:0:11631:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000001:00080000:1.0:1787580032.156459:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967307 is committed 00000004:00080000:1.0:1787580032.156487:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:1.0:1787580032.156496:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:1.0:1787580032.156502:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:1.0:1787580032.156700:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787580032.157006:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7e97c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874413262789376:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787580032.157078:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787580032.157574:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262789376 00000100:00100000:2.0:1787580032.157585:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262789376 00000100:00100000:2.0:1787580032.157682:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787580032.157694:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7efda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1874413262789376:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787580032.157724:0:6708:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:2.0:1787580032.157767:0:6708:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a8c4e7a, atime: 0x6a8c4e7a, ctime: 0x6a8c4e7a, blocks: 0x1 00010000:00010000:2.0:1787580032.157775:0:6708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0547bc8/0xc86deac20833792b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580032.157793:0:6708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=379s v=(0 0) 00010000:00010000:2.0:1787580032.157798:0:6708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787580032.157805:0:6708:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0547bc8/0xc86deac20833792b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787580032.157822:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787580032.157824:0:6708:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0547bc8/0xc86deac20833792b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580032.157835:0:6708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0547bc8/0xc86deac20833792b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580032.157844:0:6708:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a0547bc8/0xc86deac20833792b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580032.157895:0:6708:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787580032.158957:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7efda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3317:x1874413262789376:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1261us (1874us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1787580032.158966:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:3.0:1787580032.159085:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787580032.159102:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a0547bc8/0xc86deac20833792b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580032.159113:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db9400 already unused, calling callback (ffffffffc155a230) 00010000:00010000:3.0:1787580032.159118:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0547bc8/0xc86deac20833792b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580032.159128:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0547bc8/0xc86deac20833792b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580032.159154:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a0547bc8/0xc86deac20833792b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580032.159168:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0547bc8/0xc86deac20833792b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580032.159189:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787580032.159191:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787580032.159193:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787580032.159336:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8fae7e97c700/2, rc 0, transno 4294967300 00000100:00100000:0.0:1787580032.159344:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7e97c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874413262789376:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1787580032.509257:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787580032.988296:0:11681:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcde353350 20000000:00000080:3.0:1787580032.988692:0:11681:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8fae7f36e800 uarg=0000000000000000 20000000:01000000:3.0:1787580032.988732:0:11681:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1787580032.988738:0:11681:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1787580032.988743:0:11681:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:1.0:1787580032.989371:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1787580032.989895:0:11681:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:3.0:1787580032.994105:0:11681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:3.0:1787580032.994237:0:11681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:3.0:1787580032.994309:0:11681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:3.0:1787580032.994332:0:11681:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787580032.994353:0:11681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8fae4150ec00/0xc86deac208337932 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580032.994374:0:11681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fae4ca58000/0xc86deac2083377d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac2083377cd expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580032.994654:0:11681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fae50febc00/0xc86deac2083377e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac2083377db expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580032.994660:0:11681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fae4ca58800/0xc86deac2083377f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac2083377e9 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580032.994676:0:11681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fae40031000/0xc86deac2083377f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d058 expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580032.994681:0:11681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fae74ed9400/0xc86deac2083377fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d05f expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580032.994686:0:11681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8fae4150ec00/0xc86deac208337932 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580032.994719:0:11681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fae74ed9400/0xc86deac2083377fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d05f expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580032.994728:0:11681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8fae74ed9400/0xc86deac2083377fe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d05f expref: 12 pid: 5845 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580032.994739:0:11681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae74f00700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11681:1874413262789504:192.168.202.36@tcp:104: 00010000:00010000:3.0:1787580032.994824:0:11681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fae40031000/0xc86deac2083377f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d058 expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580032.994829:0:11681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8fae40031000/0xc86deac2083377f7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d058 expref: 12 pid: 5845 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580032.994835:0:11681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae74f00e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11681:1874413262789632:192.168.202.36@tcp:104: 00010000:00010000:3.0:1787580032.994852:0:11681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fae4ca58800/0xc86deac2083377f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc86deac2083377e9 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580032.994857:0:11681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fae4ca58800/0xc86deac2083377f0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc86deac2083377e9 expref: 18 pid: 5845 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580032.994871:0:11681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae74f00000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11681:1874413262789760:0@lo:104: 00000100:00100000:3.0:1787580032.994899:0:11681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787580032.994921:0:11681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fae50febc00/0xc86deac2083377e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc86deac2083377db expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580032.994926:0:11681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fae50febc00/0xc86deac2083377e2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc86deac2083377db expref: 18 pid: 5845 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580032.994934:0:11681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae74f00380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11681:1874413262789888:0@lo:104: 00000100:00100000:3.0:1787580032.994952:0:11681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787580032.994985:0:11681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fae4ca58000/0xc86deac2083377d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc86deac2083377cd expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580032.994993:0:11681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8fae4ca58000/0xc86deac2083377d4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc86deac2083377cd expref: 18 pid: 5847 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580032.994999:0:11681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae779bad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11681:1874413262790016:0@lo:104: 00000100:00100000:3.0:1787580032.995018:0:11681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580032.995025:0:11681:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae4c57c000 going to sleep for 11 seconds 00000100:00100000:1.0:1787580032.995433:0:5837:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787580032.995450:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262789760 00000100:00100000:1.0:1787580032.995457:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262789760 00000100:00100000:1.0:1787580032.995496:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262789888 00000100:00100000:1.0:1787580032.995500:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262789888 00000100:00100000:1.0:1787580032.995511:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262790016 00000100:00100000:1.0:1787580032.995514:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262790016 00000100:00100000:1.0:1787580032.995526:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787580032.995535:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74f02300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+5:11681:x1874413262789760:12345-0@lo:104: 00010000:00010000:1.0:1787580032.995550:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.136@tcp lock: ffff8fae40031a00/0xc86deac2083377e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc86deac2083377f0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580032.995612:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787580032.995618:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74f02300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+5:11681:x1874413262789760:12345-0@lo:104: Request processed in 83us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580032.995625:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787580032.995643:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787580032.995649:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74f01880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+4:11681:x1874413262789888:12345-0@lo:104: 00010000:00010000:1.0:1787580032.995656:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.136@tcp lock: ffff8fae74ed8200/0xc86deac2083377db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc86deac2083377e2 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580032.995686:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787580032.995691:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74f01880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+4:11681:x1874413262789888:12345-0@lo:104: Request processed in 43us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580032.995696:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787580032.995708:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787580032.995713:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74f0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+3:11681:x1874413262790016:12345-0@lo:104: 00010000:00010000:1.0:1787580032.995720:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.136@tcp lock: ffff8fae74ed8e00/0xc86deac2083377cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc86deac2083377d4 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580032.995764:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787580032.995770:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74f0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+3:11681:x1874413262790016:12345-0@lo:104: Request processed in 57us (750us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580032.995776:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:1.0:1787580032.995822:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787580032.995830:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.136@tcp lock: ffff8fae40031a00/0xc86deac2083377e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc86deac2083377f0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580032.995840:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae40031a00 already unused, calling callback (ffffffffc1b77c20) 10000000:00010000:1.0:1787580032.995845:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.136@tcp lock: ffff8fae40031a00/0xc86deac2083377e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc86deac2083377f0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580032.995853:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: ffff8fae40031a00/0xc86deac2083377e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc86deac2083377f0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787580032.995860:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: ffff8fae40031a00/0xc86deac2083377e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc86deac2083377f0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787580032.995866:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787580032.995897:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.136@tcp lock: ffff8fae40031a00/0xc86deac2083377e9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac2083377f0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580032.995903:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787580032.995924:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.136@tcp lock: ffff8fae40031a00/0xc86deac2083377e9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac2083377f0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580032.995931:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: ffff8fae40031a00/0xc86deac2083377e9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac2083377f0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580032.995955:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787580032.995959:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.136@tcp lock: ffff8fae74ed8200/0xc86deac2083377db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc86deac2083377e2 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580032.995965:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae74ed8200 already unused, calling callback (ffffffffc1b77c20) 10000000:00010000:1.0:1787580032.995968:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.136@tcp lock: ffff8fae74ed8200/0xc86deac2083377db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc86deac2083377e2 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580032.995975:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: ffff8fae74ed8200/0xc86deac2083377db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc86deac2083377e2 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787580032.995981:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: ffff8fae74ed8200/0xc86deac2083377db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc86deac2083377e2 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787580032.995986:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787580032.996000:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.136@tcp lock: ffff8fae74ed8200/0xc86deac2083377db lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac2083377e2 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580032.996006:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787580032.996022:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.136@tcp lock: ffff8fae74ed8200/0xc86deac2083377db lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac2083377e2 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580032.996029:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: ffff8fae74ed8200/0xc86deac2083377db lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac2083377e2 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580032.996038:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787580032.996041:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.136@tcp lock: ffff8fae74ed8e00/0xc86deac2083377cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc86deac2083377d4 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580032.996055:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae74ed8e00 already unused, calling callback (ffffffffc1b77c20) 10000000:00010000:1.0:1787580032.996058:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.136@tcp lock: ffff8fae74ed8e00/0xc86deac2083377cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc86deac2083377d4 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580032.996064:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: ffff8fae74ed8e00/0xc86deac2083377cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc86deac2083377d4 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787580032.996070:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: ffff8fae74ed8e00/0xc86deac2083377cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc86deac2083377d4 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787580032.996075:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787580032.996089:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.136@tcp lock: ffff8fae74ed8e00/0xc86deac2083377cd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac2083377d4 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580032.996096:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787580032.996102:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.136@tcp lock: ffff8fae74ed8e00/0xc86deac2083377cd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac2083377d4 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580032.996107:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: ffff8fae74ed8e00/0xc86deac2083377cd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac2083377d4 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580032.996121:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787580032.996137:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787580032.996140:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787580032.996148:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787580032.996169:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7efdaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3317:1874413262790144:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787580032.996200:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787580032.996236:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7efd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3314:1874413262790272:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787580032.996269:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787580032.996285:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787580032.996292:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7efd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3314:1874413262790400:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787580032.996324:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787580032.996352:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262790144 00000100:00100000:1.0:1787580032.996356:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262790144 00010000:00010000:1.0:1787580032.996376:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fae4ca58800/0xc86deac2083377f0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc86deac2083377e9 expref: 19 pid: 5845 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580032.996411:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262790272 00000100:00100000:1.0:1787580032.996415:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262790272 00010000:00010000:1.0:1787580032.996425:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fae50febc00/0xc86deac2083377e2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc86deac2083377db expref: 20 pid: 5845 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580032.996434:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262790400 00000100:00100000:1.0:1787580032.996436:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262790400 00010000:00010000:1.0:1787580032.996446:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fae4ca58000/0xc86deac2083377d4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc86deac2083377cd expref: 21 pid: 5847 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580032.996459:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787580032.996465:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fad43125880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+21:3317:x1874413262790144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787580032.996475:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787580032.996480:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fae4ca58800/0xc86deac2083377f0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc86deac2083377e9 expref: 21 pid: 5845 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580032.996491:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fae4ca58800/0xc86deac2083377f0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc86deac2083377e9 expref: 21 pid: 5845 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580032.996508:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787580032.996536:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fad43125880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+21:3317:x1874413262790144:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580032.996549:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787580032.996563:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787580032.996569:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fad43127800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+20:3314:x1874413262790272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787580032.996576:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787580032.996581:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fae50febc00/0xc86deac2083377e2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc86deac2083377db expref: 20 pid: 5845 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580032.996589:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fae50febc00/0xc86deac2083377e2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc86deac2083377db expref: 20 pid: 5845 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580032.996599:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787580032.996625:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fad43127800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+20:3314:x1874413262790272:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580032.996631:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787580032.996642:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787580032.996648:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae52136050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:3314:x1874413262790400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787580032.996655:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787580032.996660:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fae4ca58000/0xc86deac2083377d4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc86deac2083377cd expref: 19 pid: 5847 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580032.996667:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fae4ca58000/0xc86deac2083377d4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc86deac2083377cd expref: 19 pid: 5847 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580032.996677:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787580032.996697:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae52136050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:3314:x1874413262790400:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580032.996703:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787580032.996755:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7efdaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3317:1874413262790144:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787580032.996790:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7efd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3314:1874413262790400:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787580032.996797:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7efd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3314:1874413262790272:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787580032.997004:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787580032.997801:0:11681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fae4ca58800/0xc86deac2083377f0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc86deac2083377e9 expref: 18 pid: 5845 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580032.997815:0:11681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae74f00000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11681:1874413262789760:0@lo:104: 00010000:00010000:3.0:1787580032.997827:0:11681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fae50febc00/0xc86deac2083377e2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc86deac2083377db expref: 17 pid: 5845 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580032.997834:0:11681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae74f00380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11681:1874413262789888:0@lo:104: 00010000:00010000:3.0:1787580032.997843:0:11681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fae4ca58000/0xc86deac2083377d4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc86deac2083377cd expref: 16 pid: 5847 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580032.997862:0:11681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae779bad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11681:1874413262790016:0@lo:104: 00000100:00100000:3.0:1787580032.998027:0:11681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae74f00700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11681:1874413262789504:192.168.202.36@tcp:104: 00000100:00100000:3.0:1787580032.998035:0:11681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae74f00e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11681:1874413262789632:192.168.202.36@tcp:104: 00010000:00010000:3.0:1787580032.998057:0:11681:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8fae4150ec00/0xc86deac208337932 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580032.998364:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580032.998477:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580032.998553:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239686784 00000100:00100000:2.0:1787580032.998560:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239686784 00010000:00010000:2.0:1787580032.998591:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fae74ed9400/0xc86deac2083377fe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d05f expref: 13 pid: 5845 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580032.998620:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239686912 00000100:00100000:2.0:1787580032.998623:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239686912 00010000:00010000:2.0:1787580032.998634:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fae40031000/0xc86deac2083377f7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d058 expref: 14 pid: 5845 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580032.998647:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 33 00000100:00100000:2.0:1787580032.998654:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c91880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ff68ada-0c43-4367-93b7-ad31684360cf+14:2361:x1874413239686784:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787580032.998665:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787580032.998669:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fae74ed9400/0xc86deac2083377fe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d05f expref: 14 pid: 5845 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580032.998679:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fae74ed9400/0xc86deac2083377fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d05f expref: 14 pid: 5845 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580032.998693:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fae74ed9400/0xc86deac2083377fe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d05f expref: 14 pid: 5845 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580032.998703:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787580032.998766:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c91880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ff68ada-0c43-4367-93b7-ad31684360cf+13:2361:x1874413239686784:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 111us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580032.998773:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 33 00000100:00100000:2.0:1787580032.998789:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 34 00000100:00100000:2.0:1787580032.998796:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ff68ada-0c43-4367-93b7-ad31684360cf+12:2361:x1874413239686912:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787580032.998804:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787580032.998809:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fae40031000/0xc86deac2083377f7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d058 expref: 12 pid: 5845 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580032.998817:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fae40031000/0xc86deac2083377f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d058 expref: 12 pid: 5845 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580032.998827:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fae40031000/0xc86deac2083377f7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d058 expref: 12 pid: 5845 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580032.998839:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8fae4150ec00/0xc86deac208337932 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580032.998847:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fae4150ec00/0xc86deac208337932 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580032.998862:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fae4150ec00/0xc86deac208337932 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580032.998868:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fae4150ec00/0xc86deac208337932 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580032.998874:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8fae4150ec00/0xc86deac208337932 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580032.998880:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8fae4150ec00/0xc86deac208337932 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580032.998891:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae4150ec00 already unused, calling callback (ffffffffc155a230) 00010000:00010000:2.0:1787580032.998895:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8fae4150ec00/0xc86deac208337932 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580032.998903:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8fae4150ec00/0xc86deac208337932 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580032.998915:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8fae4150ec00/0xc86deac208337932 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580032.998925:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787580032.998945:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ff68ada-0c43-4367-93b7-ad31684360cf+11:2361:x1874413239686912:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 149us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580032.998951:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 34 00010000:00010000:3.0:1787580032.999169:0:11681:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8fae4150ec00/0xc86deac208337932 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580032.999177:0:11681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8fae4150ec00/0xc86deac208337932 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580032.999183:0:11681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fae4150ec00/0xc86deac208337932 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580033.152494:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787580033.152514:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fad43125880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874413262790528:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787580033.152573:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787580033.152631:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262790528 00000100:00100000:1.0:1787580033.152638:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262790528 00000100:00100000:1.0:1787580033.152691:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787580033.152700:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fad43127800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874413262790528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787580033.152732:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787580033.152769:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fad43127800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874413262790528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580033.152776:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:1.0:1787580033.152816:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fad43125880 x1874413262790528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787580049 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787580033.152834:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fad43125880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874413262790528:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787580033.153544:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787580033.524417:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787580033.651981:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787580033.652086:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae48c92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874413262790784:0@lo:400:kworker.0 00000100:00100000:3.0:1787580033.652152:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580033.652208:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787580033.652224:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae48c90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874413262790912:0@lo:400:kworker.0 00000100:00100000:3.0:1787580033.652245:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580033.652279:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262790784 00000100:00100000:3.0:1787580033.652286:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262790784 00000100:00100000:3.0:1787580033.652336:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262790912 00000100:00100000:3.0:1787580033.652339:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262790912 00000100:00100000:3.0:1787580033.652364:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787580033.652372:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874413262790784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787580033.652470:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874413262790784:12345-0@lo:400:kworker.0 Request processed in 97us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580033.652477:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787580033.652494:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787580033.652500:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874413262790912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787580033.652529:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874413262790912:12345-0@lo:400:kworker.0 Request processed in 29us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580033.652534:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:3.0:1787580033.652554:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787580033.652581:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae48c90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874413262790912:0@lo:400:kworker.0 00000100:00100000:3.0:1787580033.652590:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae48c92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874413262790784:0@lo:400:kworker.0 00000100:00100000:1.0:1787580033.653140:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787580033.653153:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae77aaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874413262791040:0@lo:400:kworker.0 00000100:00100000:1.0:1787580033.653202:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580033.653962:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262791040 00000100:00100000:3.0:1787580033.653971:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262791040 00000100:00100000:3.0:1787580033.654026:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787580033.654035:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fad43125880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1874413262791040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787580033.654088:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fad43125880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1874413262791040:12345-0@lo:400:kworker.0 Request processed in 54us (884us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580033.654095:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:1.0:1787580033.654239:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae77aaa680 x1874413262791040/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787580049 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787580033.654253:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae77aaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874413262791040:0@lo:400:kworker.0 00000100:00100000:2.0:1787580033.654940:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae48c91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3316:1874413262790656:0@lo:400:kworker.0 00000100:00100000:2.0:1787580033.654987:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787580033.655089:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262790656 00000100:00100000:1.0:1787580033.655109:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262790656 00000100:00100000:1.0:1787580033.655147:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1787580033.655156:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae52126850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+16:3316:x1874413262790656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787580033.661580:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae52126850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+16:3316:x1874413262790656:12345-0@lo:400:kworker.0 Request processed in 6415us (6582us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580033.661596:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1787580033.662147:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787580033.662166:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae77aa9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874413262791296:0@lo:400:kworker.0 00000100:00100000:0.0:1787580033.662231:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580033.662278:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262791296 00000100:00100000:0.0:1787580033.662285:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262791296 00000100:00100000:0.0:1787580033.662336:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787580033.662345:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae77aa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3315:x1874413262791296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787580033.662411:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae77aa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3315:x1874413262791296:12345-0@lo:400:kworker.0 Request processed in 67us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580033.662418:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787580033.662469:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae77aa9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874413262791296:0@lo:400:kworker.0 00000100:00100000:2.0:1787580033.663063:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae48c91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3316:1874413262790656:0@lo:400:kworker.0 00000100:00100000:2.0:1787580033.663078:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787580033.663085:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae77aa9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1874413262791168:0@lo:400:kworker.0 00000100:00100000:2.0:1787580033.663121:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580033.663208:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262791168 00000100:00100000:3.0:1787580033.663221:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262791168 00000100:00100000:3.0:1787580033.663276:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787580033.663284:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874413262791168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787580033.663333:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874413262791168:12345-0@lo:400:kworker.0 Request processed in 51us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580033.663340:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:2.0:1787580033.663646:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787580033.663671:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae77aa9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1874413262791168:0@lo:400:kworker.0 00000100:00100000:3.0:1787580034.164034:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787580034.164060:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fad43127480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874413262791424:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787580034.164134:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787580034.164661:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262791424 00000100:00100000:1.0:1787580034.164671:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262791424 00000100:00100000:1.0:1787580034.164755:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787580034.164765:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1874413262791424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787580034.164798:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787580034.164854:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1874413262791424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580034.164861:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787580034.164906:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fad43127480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874413262791424:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1787580034.165135:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787580034.501964:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580034.502014:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580034.502099:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580034.502363:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239687040 00000100:00100000:2.0:1787580034.502375:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239687040 00000100:00100000:3.0:1787580034.502417:0:8897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239687168 00000100:00100000:3.0:1787580034.502422:0:8897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239687168 00000100:00100000:2.0:1787580034.502465:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 256 00000100:00100000:3.0:1787580034.502475:0:8897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239687424 00000100:00100000:3.0:1787580034.502478:0:8897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239687424 00000100:00100000:2.0:1787580034.502497:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ff68ada-0c43-4367-93b7-ad31684360cf+11:2360:x1874413239687040:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:3.0:1787580034.502498:0:8897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 115 00000100:00100000:3.0:1787580034.502505:0:8897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae77aa9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+5:2360:x1874413239687168:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:2.0:1787580034.502578:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ff68ada-0c43-4367-93b7-ad31684360cf+11:2360:x1874413239687040:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 84us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580034.502586:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 256 00000100:00100000:2.0:1787580034.502627:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 116 00000100:00100000:2.0:1787580034.502634:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae77aa8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d66e8ae-0b45-4a46-9f01-8e93d52be8ea+5:2360:x1874413239687424:12345-192.168.202.36@tcp:400:kworker.0 00000100:00080000:0.0:1787580034.502696:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787580034.505955:0:8897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae77aa9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+5:2360:x1874413239687168:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 3435us (3989us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580034.505973:0:8897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 115 00000100:00100000:0.0:1787580034.507324:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580034.507632:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239687296 00000100:00100000:3.0:1787580034.507645:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239687296 00000100:00100000:3.0:1787580034.507721:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 56 00000100:00100000:3.0:1787580034.507732:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae77aa8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+5:2360:x1874413239687296:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:3.0:1787580034.507797:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae77aa8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+5:2360:x1874413239687296:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 66us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580034.507804:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 56 00000100:00080000:0.0:1787580034.507931:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787580034.508669:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae77aa8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d66e8ae-0b45-4a46-9f01-8e93d52be8ea+5:2360:x1874413239687424:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 6031us (6650us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580034.508681:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 116 00010000:00010000:1.0:1787580034.548469:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787580034.892890:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580034.893120:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239687552 00000100:00100000:1.0:1787580034.893133:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239687552 00000100:00100000:1.0:1787580034.893203:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 257 00000100:00100000:1.0:1787580034.893214:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ff68ada-0c43-4367-93b7-ad31684360cf+11:5603:x1874413239687552:12345-192.168.202.36@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787580034.893233:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787580034.893255:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fae4ca59e00/0xc86deac208337939 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d0ac expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580034.893295:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fae4ca59e00/0xc86deac208337939 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d0ac expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580034.893331:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fae4ca59e00/0xc86deac208337939 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d0ac expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580034.893340:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae4ca59e00, rc 0) 00000100:00100000:1.0:1787580034.893445:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ff68ada-0c43-4367-93b7-ad31684360cf+12:5603:x1874413239687552:12345-192.168.202.36@tcp:101:ll_cfg_requeue.0 Request processed in 231us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580034.893461:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 257 00000100:00100000:1.0:1787580034.899339:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580034.904185:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239687680 00000100:00100000:0.0:1787580034.904203:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239687680 00000100:00100000:0.0:1787580034.904278:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 258 00000100:00100000:0.0:1787580034.904299:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ff68ada-0c43-4367-93b7-ad31684360cf+12:5603:x1874413239687680:12345-192.168.202.36@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787580034.905001:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ff68ada-0c43-4367-93b7-ad31684360cf+12:5603:x1874413239687680:12345-192.168.202.36@tcp:501:ll_cfg_requeue.0 Request processed in 701us (5669us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580034.905010:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 258 00000100:00100000:0.0:1787580034.912571:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580034.912888:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239687808 00000100:00100000:1.0:1787580034.912900:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239687808 00000100:00100000:1.0:1787580034.912962:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 259 00000100:00100000:1.0:1787580034.912973:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ff68ada-0c43-4367-93b7-ad31684360cf+12:5603:x1874413239687808:12345-192.168.202.36@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787580034.913372:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ff68ada-0c43-4367-93b7-ad31684360cf+12:5603:x1874413239687808:12345-192.168.202.36@tcp:503:ll_cfg_requeue.0 Request processed in 399us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580034.913409:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 259 00000100:00100000:1.0:1787580034.920234:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580034.920439:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239687936 00000100:00100000:0.0:1787580034.920449:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239687936 00000100:00100000:0.0:1787580034.920526:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 260 00000100:00100000:0.0:1787580034.920536:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5ba0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ff68ada-0c43-4367-93b7-ad31684360cf+12:9996:x1874413239687936:12345-192.168.202.36@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787580034.920793:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5ba0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ff68ada-0c43-4367-93b7-ad31684360cf+12:9996:x1874413239687936:12345-192.168.202.36@tcp:502:llog_process_th.0 Request processed in 258us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580034.920801:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 260 10000000:01000000:1.0:1787580034.932703:0:5850:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787580034.932711:0:5850:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8fae77937800 from 7 10000000:01000000:1.0:1787580034.932716:0:5850:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787580034.932770:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae4ca59800/0xc86deac208337940 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580034.932783:0:5850:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff8fae4ca59800/0xc86deac208337940 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580034.932795:0:5850:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff8fae4ca59800/0xc86deac208337940 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580034.932840:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fad43127480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262791552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787580034.932915:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787580034.932980:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae77a32cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787580034.933140:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262791552 00000100:00100000:2.0:1787580034.933148:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262791552 00000100:00100000:2.0:1787580034.933213:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1787580034.933223:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5ba0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+16:5850:x1874413262791552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787580034.933236:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787580034.933249:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fae48db8e00/0xc86deac208337947 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc86deac208337940 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580034.933272:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fae48db8e00/0xc86deac208337947 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc86deac208337940 expref: 17 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580034.933293:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fae48db8e00/0xc86deac208337947 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac208337940 expref: 17 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580034.933302:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae48db8e00, rc 0) 00000100:00100000:2.0:1787580034.933348:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5ba0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+17:5850:x1874413262791552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580034.933365:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1787580034.933860:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fad43127480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262791552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787580034.933877:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff8fae4ca59800/0xc86deac208337940 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208337947 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580034.933887:0:5850:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff8fae4ca59800/0xc86deac208337940 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc86deac208337947 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580034.933941:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fad43127480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262791680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787580034.933972:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787580034.934003:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae77a32cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787580034.934059:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262791680 00000100:00100000:2.0:1787580034.934064:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262791680 00000100:00100000:2.0:1787580034.934099:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1787580034.934116:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5ba09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+17:5850:x1874413262791680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787580034.934441:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5ba09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+17:5850:x1874413262791680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 334us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580034.934448:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1787580034.934653:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fad43127480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262791680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787580034.934686:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae779b9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262791808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787580034.934727:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580034.934756:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fad43647540 going to sleep for 11 seconds 00000100:00100000:0.0:1787580034.934968:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580034.935110:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262791808 00000100:00100000:2.0:1787580034.935116:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262791808 00000100:00100000:2.0:1787580034.935134:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239688064 00000100:00100000:2.0:1787580034.935136:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239688064 00000100:00100000:2.0:1787580034.935147:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1787580034.935153:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5ba09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+17:5850:x1874413262791808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787580034.935332:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5ba09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+17:5850:x1874413262791808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 178us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580034.935340:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1787580034.935367:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 264 00000100:00100000:2.0:1787580034.935373:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5ba0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ff68ada-0c43-4367-93b7-ad31684360cf+12:9996:x1874413239688064:12345-192.168.202.36@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787580034.935658:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae779b9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262791808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787580034.935908:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5ba0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ff68ada-0c43-4367-93b7-ad31684360cf+12:9996:x1874413239688064:12345-192.168.202.36@tcp:502:llog_process_th.0 Request processed in 533us (939us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580034.935916:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 264 00000100:00100000:2.0:1787580034.939354:0:11695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae779ac000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:11695:1874413262791936:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787580034.939709:0:11695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787580034.939766:0:11695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae6d747e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787580034.939904:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262791936 00000100:00100000:3.0:1787580034.939914:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262791936 00000100:00100000:3.0:1787580034.939975:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1787580034.939992:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5ba0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+17:11695:x1874413262791936:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787580034.940249:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5ba0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+17:11695:x1874413262791936:12345-0@lo:502:llog_process_th.0 Request processed in 258us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580034.940256:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1787580034.940375:0:11695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae779ac000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:11695:1874413262791936:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787580034.940434:0:11695:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787580034.940445:0:11695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787580034.940447:0:11695:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787580034.940474:0:11695:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8fae77937800 00000020:00000080:0.0:1787580034.940477:0:11695:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787580034.940581:0:11695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae77aa8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:11695:1874413262792064:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787580034.940829:0:11695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580034.940862:0:11695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae45236180 going to sleep for 11 seconds 00000100:00100000:1.0:1787580034.940927:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262792064 00000100:00100000:1.0:1787580034.940933:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262792064 00000100:00100000:1.0:1787580034.940972:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1787580034.940982:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5ba08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+17:11695:x1874413262792064:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787580034.941128:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5ba08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+17:11695:x1874413262792064:12345-0@lo:502:llog_process_th.0 Request processed in 148us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580034.941135:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1787580034.942008:0:11695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae77aa8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:11695:1874413262792064:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787580034.942039:0:11695:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787580034.942046:0:11695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787580034.942048:0:11695:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1787580034.942052:0:11695:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1787580034.942350:0:5850:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1787580034.942370:0:5850:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787580034.942404:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae4ca59800/0xc86deac208337940 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208337947 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580034.942417:0:5850:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff8fae4ca59800/0xc86deac208337940 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208337947 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787580034.942436:0:5850:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787580034.942439:0:5850:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8fae50613000 from 7 10000000:01000000:1.0:1787580034.942441:0:5850:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787580034.942703:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae4ca59000/0xc86deac20833794e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580034.942713:0:5850:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff8fae4ca59000/0xc86deac20833794e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580034.942722:0:5850:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff8fae4ca59000/0xc86deac20833794e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580034.942741:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fad43127480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262792192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787580034.942790:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787580034.942830:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae77a32cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787580034.943119:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262792192 00000100:00100000:2.0:1787580034.943127:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262792192 00000100:00100000:2.0:1787580034.943169:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1787580034.943179:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5ba09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+17:5850:x1874413262792192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787580034.943191:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787580034.943215:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fae48db9200/0xc86deac208337955 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc86deac20833794e expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580034.943238:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fae48db9200/0xc86deac208337955 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc86deac20833794e expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580034.943248:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fae48db9200/0xc86deac208337955 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac20833794e expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580034.943257:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae48db9200, rc 0) 00000100:00100000:2.0:1787580034.943313:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5ba09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+18:5850:x1874413262792192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580034.943320:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1787580034.944607:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fad43127480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262792192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787580034.944702:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff8fae4ca59000/0xc86deac20833794e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208337955 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580034.944714:0:5850:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff8fae4ca59000/0xc86deac20833794e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc86deac208337955 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580034.944785:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae779baa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262792320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787580034.944830:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580034.944871:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fad43647540 going to sleep for 11 seconds 00000100:00100000:0.0:1787580034.945085:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262792320 00000100:00100000:0.0:1787580034.945091:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262792320 00000100:00100000:0.0:1787580034.945126:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1787580034.945135:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5ba08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+18:5850:x1874413262792320:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787580034.945427:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5ba08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+18:5850:x1874413262792320:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 293us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580034.945434:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1787580034.945719:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae779baa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262792320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787580034.945752:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae779baa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262792448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787580034.945791:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580034.945816:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fad43647540 going to sleep for 11 seconds 00000100:00100000:3.0:1787580034.945831:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262792448 00000100:00100000:3.0:1787580034.945834:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262792448 00000100:00100000:3.0:1787580034.945860:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1787580034.945867:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5ba08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+18:5850:x1874413262792448:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787580034.946006:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5ba08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+18:5850:x1874413262792448:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 139us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580034.946013:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1787580034.946056:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae779baa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262792448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787580034.946222:0:11696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae779baa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:11696:1874413262792576:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787580034.946254:0:11696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580034.946272:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262792576 00000100:00100000:3.0:1787580034.946275:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262792576 00000100:00100000:3.0:1787580034.946305:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1787580034.946311:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5ba0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+18:11696:x1874413262792576:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787580034.947725:0:11696:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fad43647a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787580034.947764:0:11696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae779baa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:11696:1874413262792576:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787580034.947802:0:11696:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787580034.947814:0:11696:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787580034.947816:0:11696:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787580034.947823:0:11696:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8fae50613000 00000020:00000080:2.0:1787580034.947826:0:11696:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787580034.947901:0:11696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae779aea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:11696:1874413262792704:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787580034.947953:0:11696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787580034.947980:0:11696:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae6d747300 going to sleep for 11 seconds 00000100:00100000:3.0:1787580034.948309:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5ba0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+18:11696:x1874413262792576:12345-0@lo:502:llog_process_th.0 Request processed in 156us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580034.948322:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1787580034.948414:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262792704 00000100:00100000:2.0:1787580034.948421:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262792704 00000100:00100000:2.0:1787580034.948454:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1787580034.948462:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5ba09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+18:11696:x1874413262792704:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787580034.948651:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5ba09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+18:11696:x1874413262792704:12345-0@lo:502:llog_process_th.0 Request processed in 189us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580034.948658:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1787580034.948697:0:11696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae779aea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:11696:1874413262792704:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787580034.948740:0:11696:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787580034.948745:0:11696:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787580034.948747:0:11696:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787580034.948750:0:11696:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1787580034.948878:0:5850:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1787580034.948895:0:5850:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787580034.948905:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae4ca59000/0xc86deac20833794e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208337955 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580034.948916:0:5850:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff8fae4ca59000/0xc86deac20833794e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208337955 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787580034.948927:0:5850:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787580034.948929:0:5850:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8fae6a238800 from 7 10000000:01000000:2.0:1787580034.948932:0:5850:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787580034.948954:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae48db8c00/0xc86deac20833795c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580034.948962:0:5850:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff8fae48db8c00/0xc86deac20833795c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580034.948971:0:5850:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff8fae48db8c00/0xc86deac20833795c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580034.948990:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae779aea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262792832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787580034.949015:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787580034.949036:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae6d747300 going to sleep for 11 seconds 00000100:00100000:2.0:1787580034.949047:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262792832 00000100:00100000:2.0:1787580034.949050:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262792832 00000100:00100000:2.0:1787580034.949083:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1787580034.949089:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5ba0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+18:5850:x1874413262792832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787580034.949097:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787580034.949107:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fae48db9600/0xc86deac208337963 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc86deac20833795c expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580034.949126:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fae48db9600/0xc86deac208337963 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc86deac20833795c expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580034.949135:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fae48db9600/0xc86deac208337963 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac20833795c expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580034.949144:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae48db9600, rc 0) 00000100:00100000:3.0:1787580034.949791:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580034.949818:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239688192 00000100:00100000:3.0:1787580034.949823:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239688192 00000100:00100000:3.0:1787580034.949844:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 273 00000100:00100000:3.0:1787580034.949850:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5ba08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ff68ada-0c43-4367-93b7-ad31684360cf+12:5603:x1874413239688192:12345-192.168.202.36@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787580034.949858:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787580034.949866:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fae4150ec00/0xc86deac20833796a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d0b3 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580034.949882:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fae4150ec00/0xc86deac20833796a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d0b3 expref: 13 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580034.949891:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fae4150ec00/0xc86deac20833796a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d0b3 expref: 13 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580034.949897:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae4150ec00, rc 0) 00000100:00100000:3.0:1787580034.949934:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5ba08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ff68ada-0c43-4367-93b7-ad31684360cf+13:5603:x1874413239688192:12345-192.168.202.36@tcp:101:ll_cfg_requeue.0 Request processed in 84us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580034.949948:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 273 00000100:00100000:3.0:1787580034.950053:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae779aea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262792832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787580034.950067:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff8fae48db8c00/0xc86deac20833795c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208337963 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580034.950075:0:5850:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff8fae48db8c00/0xc86deac20833795c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc86deac208337963 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580034.950129:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae779ba300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262792960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787580034.950157:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580034.950176:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae51e92e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787580034.950187:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262792960 00000100:00100000:3.0:1787580034.950191:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262792960 00000100:00100000:3.0:1787580034.950222:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1787580034.950228:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5ba0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+20:5850:x1874413262792960:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787580034.951190:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5ba0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+20:5850:x1874413262792960:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 958us (1028us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580034.951323:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae779ba300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262792960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787580034.951361:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae77aa8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262793088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787580034.951870:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1787580034.952017:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5ba0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:5850:x1874413262792832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 78us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580034.952025:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1787580034.952321:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580034.952409:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae45236f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787580034.959341:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262793088 00000100:00100000:3.0:1787580034.959355:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262793088 00000100:00100000:3.0:1787580034.959918:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580034.959946:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239688320 00000100:00100000:3.0:1787580034.959950:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239688320 00000100:00100000:3.0:1787580034.959999:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 275 00000100:00100000:3.0:1787580034.960011:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ff68ada-0c43-4367-93b7-ad31684360cf+13:5603:x1874413239688320:12345-192.168.202.36@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787580034.961279:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1787580034.961300:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5ba0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:5850:x1874413262793088:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787580034.961531:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5ba0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:5850:x1874413262793088:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 233us (9210us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580034.961540:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1787580034.961971:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ff68ada-0c43-4367-93b7-ad31684360cf+13:5603:x1874413239688320:12345-192.168.202.36@tcp:501:ll_cfg_requeue.0 Request processed in 1959us (2055us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580034.961987:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 275 00000100:00100000:0.0:1787580034.964963:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae77aa8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:5850:1874413262793088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787580034.987493:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580034.987530:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239688448 00000100:00100000:2.0:1787580034.987542:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239688448 00000100:00100000:2.0:1787580034.987593:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 277 00000100:00100000:2.0:1787580034.987604:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ff68ada-0c43-4367-93b7-ad31684360cf+13:5603:x1874413239688448:12345-192.168.202.36@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787580034.988379:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ff68ada-0c43-4367-93b7-ad31684360cf+13:5603:x1874413239688448:12345-192.168.202.36@tcp:503:ll_cfg_requeue.0 Request processed in 773us (893us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580034.988406:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 277 00000100:00100000:3.0:1787580034.998859:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580034.998901:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239688576 00000100:00100000:3.0:1787580034.998910:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239688576 00000100:00100000:3.0:1787580034.998957:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 278 00000100:00100000:3.0:1787580034.998968:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ff68ada-0c43-4367-93b7-ad31684360cf+13:9999:x1874413239688576:12345-192.168.202.36@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787580034.999246:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ff68ada-0c43-4367-93b7-ad31684360cf+13:9999:x1874413239688576:12345-192.168.202.36@tcp:502:llog_process_th.0 Request processed in 279us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580034.999255:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 278 00000100:00100000:3.0:1787580035.004333:0:11698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae779b8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:11698:1874413262793216:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787580035.004444:0:11698:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580035.004508:0:11698:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae50ee0000 going to sleep for 11 seconds 00000100:00100000:3.0:1787580035.004537:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262793216 00000100:00100000:3.0:1787580035.004545:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262793216 00000100:00100000:3.0:1787580035.004601:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1787580035.004611:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:11698:x1874413262793216:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787580035.005067:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:11698:x1874413262793216:12345-0@lo:502:llog_process_th.0 Request processed in 456us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580035.005076:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1787580035.005689:0:11698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae779b8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:11698:1874413262793216:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787580035.005726:0:11698:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787580035.005737:0:11698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787580035.005740:0:11698:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787580035.005748:0:11698:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8fae6a238800 00000020:00000080:1.0:1787580035.005750:0:11698:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787580035.006141:0:11698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fad43127480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:11698:1874413262793344:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787580035.006199:0:11698:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787580035.006223:0:11698:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae77a32e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787580035.007129:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262793344 00000100:00100000:3.0:1787580035.007139:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262793344 00000100:00100000:3.0:1787580035.007185:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1787580035.007195:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:11698:x1874413262793344:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787580035.007474:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:11698:x1874413262793344:12345-0@lo:502:llog_process_th.0 Request processed in 258us (1252us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580035.007492:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1787580035.007802:0:11698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fad43127480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:11698:1874413262793344:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787580035.007834:0:11698:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787580035.007840:0:11698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787580035.007847:0:11698:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1787580035.007851:0:11698:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1787580035.008012:0:5850:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1787580035.008038:0:5850:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787580035.008049:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae48db8c00/0xc86deac20833795c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208337963 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580035.008061:0:5850:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff8fae48db8c00/0xc86deac20833795c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208337963 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787580035.009379:0:11700:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787580035.010417:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580035.012983:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239688704 00000100:00100000:0.0:1787580035.012996:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239688704 00000100:00100000:0.0:1787580035.013045:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 281 00000100:00100000:0.0:1787580035.013055:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ff68ada-0c43-4367-93b7-ad31684360cf+13:9999:x1874413239688704:12345-192.168.202.36@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787580035.013350:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ff68ada-0c43-4367-93b7-ad31684360cf+13:9999:x1874413239688704:12345-192.168.202.36@tcp:502:llog_process_th.0 Request processed in 295us (2939us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580035.013365:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 281 00010000:00010000:1.0:1787580035.571853:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787580036.020058:0:11700:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787580036.598803:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787580037.294490:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00010000:00010000:1.0:1787580037.620360:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787580038.260088:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fad43127480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262793472:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787580038.260169:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787580038.260734:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262793472 00000100:00100000:1.0:1787580038.260744:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262793472 00000100:00100000:1.0:1787580038.260818:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787580038.260829:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262793472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787580038.260865:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787580038.260927:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262793472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (756us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580038.260934:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:3.0:1787580038.261012:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fad43127480 x1874413262793472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787580054 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787580038.261033:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fad43127480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262793472:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787580038.261113:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787580038.644578:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787580038.772955:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae779b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1874413262793856:0@lo:400:kworker.0 00000100:00100000:3.0:1787580038.773028:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580038.773124:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787580038.773131:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae779b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874413262793728:0@lo:400:kworker.0 00000100:00100000:3.0:1787580038.773154:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580038.773184:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262793856 00000100:00100000:3.0:1787580038.773192:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262793856 00000100:00100000:3.0:1787580038.773284:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262793728 00000100:00100000:3.0:1787580038.773288:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262793728 00000100:00100000:3.0:1787580038.773312:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1787580038.773321:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874413262793856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787580038.773375:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874413262793856:12345-0@lo:400:kworker.0 Request processed in 55us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580038.773406:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1787580038.773425:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787580038.773431:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874413262793728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787580038.773479:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874413262793728:12345-0@lo:400:kworker.0 Request processed in 49us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580038.773483:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:3.0:1787580038.773513:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787580038.773537:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae779b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874413262793728:0@lo:400:kworker.0 00000100:00100000:3.0:1787580038.773543:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae779b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1874413262793856:0@lo:400:kworker.0 00000100:00100000:2.0:1787580038.774104:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae779b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1874413262793984:0@lo:400:kworker.0 00000100:00100000:2.0:1787580038.774137:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787580038.774170:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787580038.774176:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae779b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3316:1874413262793600:0@lo:400:kworker.0 00000100:00100000:2.0:1787580038.774205:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787580038.774227:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae779bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262794112:0@lo:400:kworker.0 00000100:00100000:2.0:1787580038.774258:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787580038.774300:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262794112 00000100:00100000:2.0:1787580038.774304:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262794112 00000100:00100000:2.0:1787580038.774342:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787580038.774349:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262794112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787580038.774411:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262794112:12345-0@lo:400:kworker.0 Request processed in 62us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580038.774418:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:2.0:1787580038.774447:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787580038.774611:0:3316:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:2.0:1787580038.774617:0:3316:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8fae7e97c700, transno 4294967300 00000100:00100000:2.0:1787580038.774628:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae779bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262794112:0@lo:400:kworker.0 00000100:00100000:0.0:1787580038.775151:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262793984 00000100:00100000:0.0:1787580038.775156:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262793984 00000100:00100000:0.0:1787580038.775204:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1787580038.775212:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874413262793984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787580038.775272:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1874413262793984:12345-0@lo:400:kworker.0 Request processed in 60us (1134us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580038.775278:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1787580038.776547:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262793600 00000100:00100000:1.0:1787580038.776555:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262793600 00000100:00100000:1.0:1787580038.776591:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1787580038.776600:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:3316:x1874413262793600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787580038.776651:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:3316:x1874413262793600:12345-0@lo:400:kworker.0 Request processed in 53us (2444us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580038.776657:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00080000:2.0:1787580038.776765:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787580038.776789:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae779b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3316:1874413262793600:0@lo:400:kworker.0 00000100:00100000:2.0:1787580038.776799:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae779b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1874413262793984:0@lo:400:kworker.0 00000100:00100000:1.0:1787580039.286696:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fad43127480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874413262794240:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787580039.286771:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787580039.286844:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262794240 00000100:00100000:1.0:1787580039.286852:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262794240 00000100:00100000:1.0:1787580039.286893:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787580039.286903:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7efd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874413262794240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787580039.286941:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787580039.286986:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7efd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874413262794240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580039.287007:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787580039.287068:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fad43127480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874413262794240:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787580039.625322:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580039.625373:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580039.625461:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580039.625487:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580039.625523:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239688960 00000100:00100000:3.0:1787580039.625534:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239688960 00000100:00100000:3.0:1787580039.625591:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239689216 00000100:00100000:3.0:1787580039.625595:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239689216 00000100:00100000:3.0:1787580039.625618:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 120 00000100:00100000:3.0:1787580039.625628:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+5:2358:x1874413239688960:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:3.0:1787580039.625701:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+5:2358:x1874413239688960:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 74us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580039.625709:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 120 00000100:00100000:3.0:1787580039.625772:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 121 00000100:00100000:3.0:1787580039.625779:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d66e8ae-0b45-4a46-9f01-8e93d52be8ea+5:2358:x1874413239689216:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:3.0:1787580039.625807:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d66e8ae-0b45-4a46-9f01-8e93d52be8ea+5:2358:x1874413239689216:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 28us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580039.625814:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 121 00000100:00080000:2.0:1787580039.625984:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787580039.626054:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239688832 00000100:00100000:0.0:1787580039.626059:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239688832 00000100:00100000:0.0:1787580039.626099:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 283 00000100:00100000:0.0:1787580039.626107:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ff68ada-0c43-4367-93b7-ad31684360cf+13:2359:x1874413239688832:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:0.0:1787580039.626146:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ff68ada-0c43-4367-93b7-ad31684360cf+13:2359:x1874413239688832:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 40us (773us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580039.626153:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 283 00000100:00100000:1.0:1787580039.626367:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239689088 00000100:00100000:1.0:1787580039.626373:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239689088 00000100:00100000:1.0:1787580039.626451:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 58 00000100:00100000:1.0:1787580039.626459:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+5:2359:x1874413239689088:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:1.0:1787580039.626489:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+5:2359:x1874413239689088:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 32us (1029us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580039.626496:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 58 00000100:00080000:2.0:1787580039.626592:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787580039.667708:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787580040.701025:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787580041.715765:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787580042.739651:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787580043.383185:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7efd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874413262794368:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787580043.383273:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580043.386743:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262794368 00000100:00100000:0.0:1787580043.386756:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262794368 00000100:00100000:0.0:1787580043.386830:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787580043.386842:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae77aa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874413262794368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787580043.386880:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787580043.386955:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae77aa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874413262794368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (3681us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580043.386969:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:0.0:1787580043.387015:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae7efd9180 x1874413262794368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787580059 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787580043.387034:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7efd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874413262794368:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787580043.387101:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787580043.763800:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787580043.903369:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae779ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874413262794752:0@lo:400:kworker.0 00000100:00100000:2.0:1787580043.903454:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae779aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1874413262794880:0@lo:400:kworker.0 00000100:00100000:3.0:1787580043.903461:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580043.903526:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae779af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3316:1874413262794496:0@lo:400:kworker.0 00000100:00100000:1.0:1787580043.903606:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae779af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874413262794624:0@lo:400:kworker.0 00000100:00100000:2.0:1787580043.916422:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787580043.916537:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262794752 00000100:00100000:2.0:1787580043.916545:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262794752 00000100:00100000:2.0:1787580043.917957:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262794880 00000100:00100000:2.0:1787580043.917968:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262794880 00000100:00100000:2.0:1787580043.918268:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1787580043.918280:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874413262794752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787580043.919048:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874413262794752:12345-0@lo:400:kworker.0 Request processed in 769us (15583us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580043.919089:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1787580043.919115:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1787580043.919123:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874413262794880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787580043.919183:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874413262794880:12345-0@lo:400:kworker.0 Request processed in 60us (3196us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580043.919190:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:2.0:1787580043.919231:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787580043.919293:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae779aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1874413262794880:0@lo:400:kworker.0 00000100:00100000:0.0:1787580043.920523:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580043.920583:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae779ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262795008:0@lo:400:kworker.0 00000100:00100000:0.0:1787580043.920623:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580043.920679:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262795008 00000100:00100000:0.0:1787580043.920686:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262795008 00000100:00100000:0.0:1787580043.920736:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787580043.920746:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae77aaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262795008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787580043.920792:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae77aaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262795008:12345-0@lo:400:kworker.0 Request processed in 48us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580043.920799:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:0.0:1787580043.920821:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787580043.921372:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae779ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262795008:0@lo:400:kworker.0 00000100:00100000:2.0:1787580043.921545:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262794496 00000100:00100000:2.0:1787580043.921561:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262794496 00000100:00100000:2.0:1787580043.921604:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1787580043.921612:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:3316:x1874413262794496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787580043.921669:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:3316:x1874413262794496:12345-0@lo:400:kworker.0 Request processed in 58us (1150us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580043.921676:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1787580043.921847:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae779af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3316:1874413262794496:0@lo:400:kworker.0 00000100:00100000:1.0:1787580043.922084:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787580043.923333:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262794624 00000100:00100000:2.0:1787580043.923343:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262794624 00000100:00100000:2.0:1787580043.923437:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1787580043.923447:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7efdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874413262794624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787580043.923511:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7efdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874413262794624:12345-0@lo:400:kworker.0 Request processed in 67us (1442us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580043.923519:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1787580043.924894:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae779af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874413262794624:0@lo:400:kworker.0 00000100:00100000:3.0:1787580043.925067:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae779ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874413262794752:0@lo:400:kworker.0 00000100:00100000:0.0:1787580044.403676:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787580044.403702:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7efd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262795136:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787580044.403777:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787580044.403921:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262795136 00000100:00100000:2.0:1787580044.403930:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262795136 00000100:00100000:2.0:1787580044.403990:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787580044.404002:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae77aa9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262795136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787580044.404053:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787580044.404122:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae77aa9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262795136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580044.404130:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787580044.404222:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7efd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262795136:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787580044.741218:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580044.741262:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580044.741306:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580044.741353:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580044.741461:0:8897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239689472 00000100:00100000:2.0:1787580044.741472:0:8897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239689472 00000100:00100000:2.0:1787580044.741548:0:8897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239689728 00000100:00100000:2.0:1787580044.741551:0:8897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239689728 00000100:00100000:2.0:1787580044.741575:0:8897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 125 00000100:00100000:2.0:1787580044.741584:0:8897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+5:2358:x1874413239689472:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:2.0:1787580044.741675:0:8897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+5:2358:x1874413239689472:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 92us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580044.741682:0:8897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 125 00000100:00100000:2.0:1787580044.741699:0:8897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 126 00000100:00100000:2.0:1787580044.741706:0:8897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8d66e8ae-0b45-4a46-9f01-8e93d52be8ea+5:2358:x1874413239689728:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:2.0:1787580044.741729:0:8897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8d66e8ae-0b45-4a46-9f01-8e93d52be8ea+5:2358:x1874413239689728:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 24us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580044.741733:0:8897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 126 00000100:00100000:1.0:1787580044.741885:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239689344 00000100:00100000:1.0:1787580044.741890:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239689344 00000100:00100000:1.0:1787580044.741921:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 285 00000100:00100000:1.0:1787580044.741926:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ff68ada-0c43-4367-93b7-ad31684360cf+13:2358:x1874413239689344:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:1.0:1787580044.741949:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ff68ada-0c43-4367-93b7-ad31684360cf+13:2358:x1874413239689344:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 24us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580044.741953:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 285 00000100:00100000:1.0:1787580044.741973:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239689600 00000100:00100000:1.0:1787580044.741997:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239689600 00000100:00100000:1.0:1787580044.742027:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 60 00000100:00100000:1.0:1787580044.742033:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+5:2358:x1874413239689600:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:1.0:1787580044.742061:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+5:2358:x1874413239689600:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 28us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580044.742066:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 60 00000100:00080000:3.0:1787580044.742320:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787580044.742325:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787580044.791664:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787580045.811919:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787580046.260357:0:11700:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787580046.835731:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787580047.861957:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787580048.499696:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7efd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874413262795264:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787580048.499772:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580048.499920:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262795264 00000100:00100000:0.0:1787580048.499929:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262795264 00000100:00100000:0.0:1787580048.499995:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787580048.500029:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874413262795264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787580048.500063:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787580048.500111:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874413262795264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580048.500118:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:3.0:1787580048.500308:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787580048.500342:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae7efd9180 x1874413262795264/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787580064 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787580048.500357:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7efd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874413262795264:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787580048.884368:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787580049.012229:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae779aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3315:1874413262795392:0@lo:400:kworker.0 00000100:00100000:0.0:1787580049.012310:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787580049.012497:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae779af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874413262795776:0@lo:400:kworker.0 00000100:00100000:1.0:1787580049.012532:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787580049.012594:0:8897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262795776 00000100:00100000:1.0:1787580049.012602:0:8897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262795776 00000100:00100000:1.0:1787580049.012677:0:8897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1787580049.012689:0:8897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7efd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874413262795776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787580049.012753:0:8897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7efd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874413262795776:12345-0@lo:400:kworker.0 Request processed in 67us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580049.012761:0:8897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1787580049.012815:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae779af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874413262795776:0@lo:400:kworker.0 00000100:00100000:3.0:1787580049.012918:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262795392 00000100:00100000:3.0:1787580049.012923:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262795392 00000100:00100000:3.0:1787580049.012966:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1787580049.012974:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:3315:x1874413262795392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787580049.013790:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae779ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1874413262795648:0@lo:400:kworker.0 00000100:00100000:1.0:1787580049.013826:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787580049.013855:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787580049.013861:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae779ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874413262795520:0@lo:400:kworker.0 00000100:00100000:1.0:1787580049.013883:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787580049.013913:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262795648 00000100:00100000:1.0:1787580049.013917:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262795648 00000100:00100000:1.0:1787580049.013956:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262795520 00000100:00100000:1.0:1787580049.013959:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262795520 00000100:00100000:1.0:1787580049.013973:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787580049.013991:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fad43127480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874413262795648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787580049.014027:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fad43127480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874413262795648:12345-0@lo:400:kworker.0 Request processed in 47us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580049.014034:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787580049.014046:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1787580049.014052:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7f5ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874413262795520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787580049.014079:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7f5ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874413262795520:12345-0@lo:400:kworker.0 Request processed in 26us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580049.014084:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1787580049.014114:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae779ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874413262795520:0@lo:400:kworker.0 00000100:00100000:1.0:1787580049.014123:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae779ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1874413262795648:0@lo:400:kworker.0 00000100:00080000:2.0:1787580049.018735:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787580049.019244:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787580049.019268:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae779af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874413262795904:0@lo:400:kworker.0 00000100:00100000:1.0:1787580049.019346:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787580049.022666:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262795904 00000100:00100000:2.0:1787580049.022684:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262795904 00000100:00100000:2.0:1787580049.022815:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787580049.022827:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7f5bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874413262795904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787580049.022954:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7f5bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874413262795904:12345-0@lo:400:kworker.0 Request processed in 129us (3607us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580049.023286:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:1.0:1787580049.023476:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787580049.023520:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae779af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874413262795904:0@lo:400:kworker.0 00000100:00100000:3.0:1787580049.024278:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:3315:x1874413262795392:12345-0@lo:400:kworker.0 Request processed in 11301us (11964us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580049.024289:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1787580049.024431:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae779aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3315:1874413262795392:0@lo:400:kworker.0 00000100:00100000:2.0:1787580049.523757:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787580049.523789:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae74f00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874413262796032:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787580049.523857:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580049.524293:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262796032 00000100:00100000:0.0:1787580049.524301:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262796032 00000100:00100000:0.0:1787580049.524358:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787580049.524369:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874413262796032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787580049.524423:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787580049.524483:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874413262796032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580049.524491:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787580049.524613:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae74f00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874413262796032:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787580049.863856:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580049.863903:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580049.864060:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239689856 00000100:00100000:2.0:1787580049.864071:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239689856 00000100:00100000:2.0:1787580049.864137:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 287 00000100:00100000:2.0:1787580049.864157:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ff68ada-0c43-4367-93b7-ad31684360cf+13:2359:x1874413239689856:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:2.0:1787580049.864255:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ff68ada-0c43-4367-93b7-ad31684360cf+13:2359:x1874413239689856:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 109us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580049.864263:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 287 00000100:00100000:1.0:1787580049.868547:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239689984 00000100:00100000:1.0:1787580049.868569:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239689984 00000100:00100000:1.0:1787580049.868688:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 130 00000100:00100000:1.0:1787580049.868701:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+5:2359:x1874413239689984:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:1.0:1787580049.868794:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+5:2359:x1874413239689984:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 96us (4888us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580049.868819:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 130 00000100:00080000:2.0:1787580049.868977:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787580049.869458:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580049.869512:0:8897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239690240 00000100:00100000:1.0:1787580049.869518:0:8897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239690240 00000100:00100000:1.0:1787580049.869573:0:8897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 131 00000100:00100000:1.0:1787580049.869581:0:8897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8d66e8ae-0b45-4a46-9f01-8e93d52be8ea+5:2359:x1874413239690240:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:1.0:1787580049.869636:0:8897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8d66e8ae-0b45-4a46-9f01-8e93d52be8ea+5:2359:x1874413239690240:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 55us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580049.869643:0:8897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 131 00000100:00080000:2.0:1787580049.869704:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787580049.871685:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580049.871843:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239690112 00000100:00100000:1.0:1787580049.871852:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239690112 00000100:00100000:1.0:1787580049.871933:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 19 00000100:00100000:1.0:1787580049.871945:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+5:2357:x1874413239690112:12345-192.168.202.36@tcp:9:kworker.0 00000020:00000080:1.0:1787580049.871987:0:6707:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc86deac2083378a6 00000100:00080000:1.0:1787580049.871996:0:6707:0:(import.c:65:import_set_state_nolock()) ffff8fae5ff33000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787580049.872050:0:6707:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:1.0:1787580049.872325:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+2:2357:x1874413239690112:12345-192.168.202.36@tcp:9:kworker.0 Request processed in 382us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580049.872333:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 19 00000100:00080000:2.0:1787580049.876193:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787580049.876496:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787580049.910014:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787580050.932477:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787580051.955694:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787580052.649567:0:7653:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 31d1df27-21ab-4c76-bd19-e53fa778bd7e 00000020:00000080:1.0:1787580052.649583:0:7653:0:(genops.c:885:class_export_put()) final put ffff8fae5ff35800/31d1df27-21ab-4c76-bd19-e53fa778bd7e 00000020:00000080:2.0:1787580052.649839:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8fae5ff35800/31d1df27-21ab-4c76-bd19-e53fa778bd7e for lustre-OST0001 00000020:00000080:2.0:1787580052.649908:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8fae5ff33000 for lustre-OST0001 00010000:00010000:3.0:1787580052.979595:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787580053.620827:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae74f00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874413262796160:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787580053.620901:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787580053.621034:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262796160 00000100:00100000:1.0:1787580053.621049:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262796160 00000100:00100000:1.0:1787580053.621125:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787580053.621137:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74f00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874413262796160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787580053.621179:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787580053.621227:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74f00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874413262796160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580053.621234:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:1.0:1787580053.621255:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787580053.621287:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae74f00700 x1874413262796160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787580069 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787580053.621306:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae74f00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874413262796160:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787580054.003588:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787580054.142585:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae74f02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874413262796544:0@lo:400:kworker.0 00000100:00100000:1.0:1787580054.142682:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787580054.142789:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262796544 00000100:00100000:1.0:1787580054.142797:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262796544 00000100:00100000:1.0:1787580054.142861:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1787580054.142871:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74f01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874413262796544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787580054.142927:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74f01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874413262796544:12345-0@lo:400:kworker.0 Request processed in 58us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580054.142934:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00080000:1.0:1787580054.142954:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787580054.142986:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae74f02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874413262796544:0@lo:400:kworker.0 00000100:00100000:1.0:1787580054.143023:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae74f02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1874413262796672:0@lo:400:kworker.0 00000100:00100000:1.0:1787580054.143060:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580054.143343:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae74f00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874413262796416:0@lo:400:kworker.0 00000100:00100000:0.0:1787580054.143376:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580054.143425:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787580054.143431:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae74f00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3315:1874413262796288:0@lo:400:kworker.0 00000100:00100000:0.0:1787580054.143458:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580054.143482:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d661880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874413262796800:0@lo:400:kworker.0 00000100:00100000:0.0:1787580054.143507:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580054.143532:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262796672 00000100:00100000:0.0:1787580054.143536:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262796672 00000100:00100000:0.0:1787580054.143575:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262796416 00000100:00100000:0.0:1787580054.143578:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262796416 00000100:00100000:0.0:1787580054.143596:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787580054.143602:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74f00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1874413262796672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787580054.143641:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74f00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1874413262796672:12345-0@lo:400:kworker.0 Request processed in 38us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580054.143662:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787580054.143678:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787580054.143684:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae77aaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874413262796416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787580054.143718:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae77aaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874413262796416:12345-0@lo:400:kworker.0 Request processed in 35us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580054.143724:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787580054.143741:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262796288 00000100:00100000:0.0:1787580054.143745:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262796288 00000100:00100000:0.0:1787580054.143763:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1787580054.143770:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:3315:x1874413262796288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787580054.143799:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:3315:x1874413262796288:12345-0@lo:400:kworker.0 Request processed in 30us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580054.143805:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1787580054.143837:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae74f00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3315:1874413262796288:0@lo:400:kworker.0 00000100:00100000:0.0:1787580054.143847:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae74f00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874413262796416:0@lo:400:kworker.0 00000100:00080000:0.0:1787580054.143865:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787580054.143884:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae74f02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1874413262796672:0@lo:400:kworker.0 00000100:00100000:2.0:1787580054.144152:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262796800 00000100:00100000:2.0:1787580054.144157:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262796800 00000100:00100000:2.0:1787580054.144203:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787580054.144211:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7e97c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1874413262796800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787580054.144251:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7e97c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1874413262796800:12345-0@lo:400:kworker.0 Request processed in 42us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580054.144258:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787580054.144289:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d661880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874413262796800:0@lo:400:kworker.0 00000100:00080000:0.0:1787580054.145954:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787580054.644323:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787580054.644352:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d660380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874413262796928:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787580054.644444:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787580054.644511:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262796928 00000100:00100000:1.0:1787580054.644519:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262796928 00000100:00100000:1.0:1787580054.644566:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787580054.644576:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d662680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874413262796928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787580054.644616:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787580054.644659:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d662680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874413262796928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580054.644667:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787580054.644717:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d660380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874413262796928:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787580054.983757:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580054.983801:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580054.983826:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580054.983854:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239690368 00000100:00100000:2.0:1787580054.983863:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239690368 00000100:00100000:2.0:1787580054.983909:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 289 00000100:00100000:2.0:1787580054.983919:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ff68ada-0c43-4367-93b7-ad31684360cf+13:2358:x1874413239690368:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:2.0:1787580054.984829:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ff68ada-0c43-4367-93b7-ad31684360cf+13:2358:x1874413239690368:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 906us (1075us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580054.984840:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 289 00000100:00100000:2.0:1787580054.984885:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239690496 00000100:00100000:2.0:1787580054.984890:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239690496 00000100:00100000:2.0:1787580054.985044:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239690624 00000100:00100000:2.0:1787580054.985048:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239690624 00000100:00100000:2.0:1787580054.985079:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 135 00000100:00100000:2.0:1787580054.985087:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+5:2359:x1874413239690496:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:2.0:1787580054.985133:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+5:2359:x1874413239690496:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 47us (1331us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580054.985140:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 135 00000100:00100000:2.0:1787580054.985153:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 136 00000100:00100000:2.0:1787580054.985159:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d66e8ae-0b45-4a46-9f01-8e93d52be8ea+5:2358:x1874413239690624:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:2.0:1787580054.985183:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d66e8ae-0b45-4a46-9f01-8e93d52be8ea+5:2358:x1874413239690624:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 24us (1356us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580054.985206:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 136 00000100:00080000:2.0:1787580054.987180:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787580055.029442:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787580056.051666:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787580056.500075:0:11700:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787580057.076556:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787580057.451601:0:11864:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 10:00:55 (1787580055) 00010000:00010000:1.0:1787580058.099925:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787580058.743318:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787580058.743354:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d660380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874413262797056:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787580058.743527:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787580058.744082:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262797056 00000100:00100000:1.0:1787580058.744095:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262797056 00000100:00100000:1.0:1787580058.744227:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787580058.744240:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74f02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874413262797056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787580058.744290:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787580058.744364:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74f02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874413262797056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (837us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580058.744372:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:0.0:1787580058.744555:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae6d660380 x1874413262797056/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787580074 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787580058.744582:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d660380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874413262797056:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787580058.745672:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787580059.124575:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787580059.251855:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae48c91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1874413262797440:0@lo:400:kworker.0 00000100:00100000:3.0:1787580059.251975:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580059.252075:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787580059.252083:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae779b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874413262797312:0@lo:400:kworker.0 00000100:00100000:3.0:1787580059.252112:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580059.252133:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae74ed2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874413262797824:0@lo:400:kworker.0 00000100:00100000:3.0:1787580059.252163:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580059.252201:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262797440 00000100:00100000:3.0:1787580059.252210:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262797440 00000100:00100000:3.0:1787580059.252273:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262797312 00000100:00100000:3.0:1787580059.252277:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262797312 00000100:00100000:3.0:1787580059.252303:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1787580059.252312:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74ed0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874413262797440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787580059.252373:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74ed0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874413262797440:12345-0@lo:400:kworker.0 Request processed in 62us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580059.252532:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1787580059.252556:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1787580059.252563:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74ed0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874413262797312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787580059.252597:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74ed0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874413262797312:12345-0@lo:400:kworker.0 Request processed in 35us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580059.252604:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1787580059.252651:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae779b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874413262797312:0@lo:400:kworker.0 00000100:00100000:3.0:1787580059.252678:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae48c91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1874413262797440:0@lo:400:kworker.0 00000100:00100000:1.0:1787580059.252787:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262797824 00000100:00100000:1.0:1787580059.252792:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262797824 00000100:00100000:1.0:1787580059.252840:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787580059.252849:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74ed0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1874413262797824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787580059.252911:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74ed0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1874413262797824:12345-0@lo:400:kworker.0 Request processed in 64us (747us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580059.252918:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787580059.254744:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae74ed2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874413262797824:0@lo:400:kworker.0 00000100:00100000:0.0:1787580059.255192:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae779baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3317:1874413262797184:0@lo:400:kworker.0 00000100:00100000:0.0:1787580059.255301:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580059.255376:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae48c90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1874413262797696:0@lo:400:kworker.0 00000100:00100000:1.0:1787580059.255464:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262797184 00000100:00100000:0.0:1787580059.255468:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787580059.255488:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262797184 00000100:00100000:0.0:1787580059.255510:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787580059.255522:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae48c92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874413262797568:0@lo:400:kworker.0 00000100:00100000:0.0:1787580059.255566:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787580059.255587:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1787580059.255604:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:3317:x1874413262797184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787580059.255617:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262797696 00000100:00100000:0.0:1787580059.255627:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262797696 00000100:00100000:0.0:1787580059.255707:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1787580059.255719:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74f00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1874413262797696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787580059.255759:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c41050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:3317:x1874413262797184:12345-0@lo:400:kworker.0 Request processed in 158us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580059.255771:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1787580059.255789:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74f00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1874413262797696:12345-0@lo:400:kworker.0 Request processed in 70us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580059.255799:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787580059.255949:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262797568 00000100:00100000:2.0:1787580059.255955:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262797568 00000100:00100000:2.0:1787580059.255997:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787580059.256005:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74f00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1874413262797568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787580059.256051:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74f00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1874413262797568:12345-0@lo:400:kworker.0 Request processed in 48us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580059.256058:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:2.0:1787580059.256102:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787580059.256110:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787580059.256114:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae779baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3317:1874413262797184:0@lo:400:kworker.0 00000100:00100000:1.0:1787580059.256148:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae48c90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1874413262797696:0@lo:400:kworker.0 00010000:00080000:1.0:1787580059.256186:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae48c92680 x1874413262797568/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787580075 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787580059.256197:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae48c92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874413262797568:0@lo:400:kworker.0 00000100:00100000:3.0:1787580059.393099:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580059.393376:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239690752 00000100:00100000:0.0:1787580059.393464:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239690752 00000100:00100000:0.0:1787580059.393582:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 32 00000100:00100000:0.0:1787580059.393596:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74ed2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+5:10269:x1874413239690752:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787580059.393627:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787580059.393663:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac208337971 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d0ba expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580059.393776:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb200/0xc86deac208337978 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580059.393795:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb200/0xc86deac208337978 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580059.393811:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb200/0xc86deac208337978 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787580059.394224:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:0.0:1787580059.394448:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787580059.394454:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787580059.394571:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb200/0xc86deac208337978 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580059.394612:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac208337971 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d0ba expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580059.394635:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb200/0xc86deac208337978 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d0ba expref: 6 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580059.394646:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fae56e35d00) 00010000:00010000:0.0:1787580059.394649:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787580059.394655:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae50feb200, rc 0) 00000100:00100000:0.0:1787580059.394751:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74ed2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:10269:x1874413239690752:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 Request processed in 1157us (1669us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580059.394760:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 32 00000100:00100000:2.0:1787580059.423264:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580059.423502:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239690880 00000100:00100000:0.0:1787580059.423516:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239690880 00000100:00100000:0.0:1787580059.423662:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 33 00000100:00100000:0.0:1787580059.423677:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:10270:x1874413239690880:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787580059.423706:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787580059.423735:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac20833797f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d0c1 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580059.423830:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feaa00/0xc86deac208337986 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580059.423920:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feaa00/0xc86deac208337986 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580059.423936:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feaa00/0xc86deac208337986 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580059.423954:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb000/0xc86deac20833798d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580059.423962:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb000/0xc86deac20833798d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580059.423969:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb000/0xc86deac20833798d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580059.424753:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50febc00/0xc86deac208337994 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580059.424767:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50febc00/0xc86deac208337994 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580059.424775:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50febc00/0xc86deac208337994 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787580059.425532:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1787580059.425541:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787580059.425638:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50febc00/0xc86deac208337994 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580059.425656:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feaa00/0xc86deac208337986 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580059.425663:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feaa00/0xc86deac208337986 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580059.425671:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feaa00/0xc86deac208337986 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580059.425678:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae50feaa00 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:0.0:1787580059.425683:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feaa00/0xc86deac208337986 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580059.425691:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feaa00/0xc86deac208337986 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580059.425705:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fae56e35d00) 00010000:00010000:0.0:1787580059.425709:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787580059.425714:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feaa00/0xc86deac208337986 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580059.425721:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feaa00/0xc86deac208337986 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580059.425736:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb000/0xc86deac20833798d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580059.425754:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb000/0xc86deac20833798d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580059.425761:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb000/0xc86deac20833798d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580059.425766:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae50feb000 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:0.0:1787580059.425769:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb000/0xc86deac20833798d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580059.425775:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb000/0xc86deac20833798d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580059.425783:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8fae56e35400) 00010000:00010000:0.0:1787580059.425786:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787580059.425788:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb000/0xc86deac20833798d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580059.425794:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb000/0xc86deac20833798d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580059.425920:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac20833797f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d0c1 expref: 8 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580059.425941:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50febc00/0xc86deac208337994 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d0c1 expref: 7 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580059.425948:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8fae56e35700) 00010000:00010000:0.0:1787580059.425951:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787580059.425959:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae50febc00, rc 0) 00000100:00100000:0.0:1787580059.426143:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+7:10270:x1874413239690880:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 Request processed in 2467us (2895us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580059.426154:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 33 00000100:00100000:2.0:1787580059.436727:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580059.436868:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239691136 00000100:00100000:1.0:1787580059.436883:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239691136 00000100:00100000:1.0:1787580059.437176:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 34 00000100:00100000:1.0:1787580059.437193:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+7:10270:x1874413239691136:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787580059.437226:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787580059.437263:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58800/0xc86deac20833799b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d0c8 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580059.437372:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58600/0xc86deac2083379a2 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580059.437605:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58600/0xc86deac2083379a2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580059.437621:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58600/0xc86deac2083379a2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580059.437642:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac2083379a9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580059.437650:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac2083379a9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580059.437658:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac2083379a9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580059.439296:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59600/0xc86deac2083379b0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580059.439321:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59600/0xc86deac2083379b0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580059.439331:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59600/0xc86deac2083379b0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787580059.439345:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1787580059.439670:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58600/0xc86deac2083379a2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580059.439679:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58600/0xc86deac2083379a2 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580059.439687:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58600/0xc86deac2083379a2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580059.439703:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae4ca58600 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:1.0:1787580059.439709:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58600/0xc86deac2083379a2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580059.439717:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58600/0xc86deac2083379a2 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580059.439733:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8fae56e35700) 00010000:00010000:1.0:1787580059.439737:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787580059.439743:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58600/0xc86deac2083379a2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580059.439749:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58600/0xc86deac2083379a2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580059.439764:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac2083379a9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580059.439769:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac2083379a9 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580059.439774:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac2083379a9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580059.439779:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae4ca59200 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:1.0:1787580059.439782:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac2083379a9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580059.439788:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac2083379a9 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580059.439806:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8fae5bb2f600) 00010000:00010000:1.0:1787580059.439808:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787580059.439812:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac2083379a9 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580059.439817:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac2083379a9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580059.442471:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58800/0xc86deac20833799b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d0c8 expref: 10 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580059.442511:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59600/0xc86deac2083379b0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d0c8 expref: 9 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580059.442522:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8fae5bb2f000) 00010000:00010000:1.0:1787580059.442526:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787580059.442530:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae4ca59600, rc 0) 00000100:00100000:1.0:1787580059.445026:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+9:10270:x1874413239691136:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 Request processed in 5973us (6453us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1787580059.445046:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 34 00000100:00100000:3.0:1787580059.459582:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580059.464697:0:8897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239691264 00000100:00100000:0.0:1787580059.464714:0:8897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239691264 00000100:00100000:0.0:1787580059.464958:0:8897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 35 00000100:00100000:0.0:1787580059.464974:0:8897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74ed1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+9:10270:x1874413239691264:12345-192.168.202.36@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1787580059.465193:0:8897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74ed1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+9:10270:x1874413239691264:12345-192.168.202.36@tcp:59:lhsmtool_posix.0 Request processed in 222us (5826us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580059.465201:0:8897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 35 00000040:00080000:3.0:1787580059.572624:0:11700:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787580059.766226:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787580059.766249:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7f35dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874413262797952:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787580059.766326:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580059.766409:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262797952 00000100:00100000:0.0:1787580059.766417:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262797952 00000100:00100000:0.0:1787580059.766474:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787580059.766485:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7f35f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874413262797952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787580059.766526:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787580059.766577:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7f35f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874413262797952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580059.766584:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787580059.766616:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7f35dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874413262797952:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787580060.101672:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580060.101764:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580060.101798:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580060.101851:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239691392 00000100:00100000:2.0:1787580060.101861:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239691392 00000100:00100000:2.0:1787580060.101927:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 291 00000100:00100000:2.0:1787580060.101938:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ff68ada-0c43-4367-93b7-ad31684360cf+13:2358:x1874413239691392:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:2.0:1787580060.102009:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ff68ada-0c43-4367-93b7-ad31684360cf+13:2358:x1874413239691392:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 72us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580060.102016:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 291 00000100:00100000:0.0:1787580060.104052:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239691520 00000100:00100000:0.0:1787580060.104074:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239691520 00000100:00100000:0.0:1787580060.104171:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239691648 00000100:00100000:0.0:1787580060.104175:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239691648 00000100:00080000:3.0:1787580060.104250:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787580060.104444:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 140 00000100:00100000:1.0:1787580060.104456:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74ed0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+9:2358:x1874413239691520:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:1.0:1787580060.104550:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74ed0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+9:2358:x1874413239691520:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 96us (2888us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580060.104557:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 140 00000100:00100000:1.0:1787580060.104573:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 141 00000100:00100000:1.0:1787580060.104596:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74ed3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d66e8ae-0b45-4a46-9f01-8e93d52be8ea+5:2358:x1874413239691648:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:1.0:1787580060.104622:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74ed3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d66e8ae-0b45-4a46-9f01-8e93d52be8ea+5:2358:x1874413239691648:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 28us (2824us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580060.104628:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 141 00010000:00010000:1.0:1787580060.148288:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787580061.182270:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787580061.840630:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580061.840672:0:8897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239691776 00000100:00100000:2.0:1787580061.840682:0:8897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239691776 00000100:00100000:2.0:1787580061.841157:0:8897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 36 00000100:00100000:2.0:1787580061.841169:0:8897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+9:10321:x1874413239691776:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:2.0:1787580061.841191:0:8897:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787580061.841213:0:8897:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac2083379be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d0cf expref: -99 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580061.841302:0:8897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac2083379c5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580061.841318:0:8897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac2083379c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580061.841332:0:8897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac2083379c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580061.841349:0:8897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac2083379cc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580061.841356:0:8897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac2083379cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580061.841363:0:8897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac2083379cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580061.841696:0:8897:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac2083379c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580061.841705:0:8897:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac2083379c5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787580061.845215:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787580061.848137:0:8897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac2083379c5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580061.848158:0:8897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db8800 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:2.0:1787580061.848164:0:8897:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac2083379c5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580061.848185:0:8897:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac2083379c5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580061.848207:0:8897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fae56e35d00) 00010000:00010000:2.0:1787580061.848210:0:8897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787580061.848215:0:8897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac2083379c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580061.848223:0:8897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac2083379c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580061.848238:0:8897:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac2083379cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580061.848245:0:8897:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac2083379cc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580061.848251:0:8897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac2083379cc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580061.848256:0:8897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db9c00 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:2.0:1787580061.848259:0:8897:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac2083379cc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580061.848265:0:8897:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac2083379cc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580061.848272:0:8897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8fae4c7d9200) 00010000:00010000:2.0:1787580061.848274:0:8897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787580061.848277:0:8897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac2083379cc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580061.848293:0:8897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac2083379cc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580061.848350:0:8897:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac2083379be lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d0cf expref: 10 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580061.848361:0:8897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fae56e35d00) 00010000:00010000:2.0:1787580061.848364:0:8897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787580061.848367:0:8897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac2083379be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d0cf expref: 10 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580061.848376:0:8897:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae48db9e00, rc 0) 00000100:00100000:2.0:1787580061.848479:0:8897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+9:10321:x1874413239691776:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 7311us (7859us total) trans 0 rc 301/301 00000100:00100000:2.0:1787580061.848489:0:8897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 36 00000100:00100000:1.0:1787580061.857913:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580061.858341:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239692032 00000100:00100000:0.0:1787580061.858355:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239692032 00000100:00100000:0.0:1787580061.858900:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 37 00000100:00100000:0.0:1787580061.858913:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d661f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+9:10321:x1874413239692032:12345-192.168.202.36@tcp:36:lfs.0 00010000:00010000:0.0:1787580061.859245:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787580061.859286:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb200/0xc86deac208337978 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d0ba expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580061.859306:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fae56e35d00) 00010000:00010000:0.0:1787580061.859319:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787580061.861607:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50febe00/0xc86deac2083379d3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580061.861634:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50febe00/0xc86deac2083379d3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580061.861646:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50febe00/0xc86deac2083379d3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580061.861659:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feae00/0xc86deac2083379da lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580061.861666:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feae00/0xc86deac2083379da lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580061.861672:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feae00/0xc86deac2083379da lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787580061.907829:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1787580061.907856:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50febe00/0xc86deac2083379d3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580061.907867:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50febe00/0xc86deac2083379d3 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580061.907874:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50febe00/0xc86deac2083379d3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580061.907880:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae50febe00 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:1.0:1787580061.907886:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50febe00/0xc86deac2083379d3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580061.907893:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50febe00/0xc86deac2083379d3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580061.907911:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fae56e35400) 00010000:00010000:1.0:1787580061.907914:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787580061.907919:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50febe00/0xc86deac2083379d3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580061.907926:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50febe00/0xc86deac2083379d3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787580061.907961:0:5854:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f7ce48f9 reply state 00000000b3b1de34 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feae00/0xc86deac2083379da lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580061.907969:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787580061.910773:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d661f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+10:10321:x1874413239692032:12345-192.168.202.36@tcp:36:lfs.0 Request processed in 51849us (52862us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1787580061.910789:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 37 00010000:00010000:0.0:1787580061.920994:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feae00/0xc86deac2083379da lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580061.921011:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feae00/0xc86deac2083379da lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580061.921572:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feae00/0xc86deac2083379da lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580061.921579:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae50feae00 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:0.0:1787580061.921584:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feae00/0xc86deac2083379da lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580061.921592:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feae00/0xc86deac2083379da lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580061.921613:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8fae56e35900) 00010000:00010000:0.0:1787580061.921616:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787580061.921621:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feae00/0xc86deac2083379da lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580061.921627:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feae00/0xc86deac2083379da lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580062.008808:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580062.009161:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239692160 00000100:00100000:1.0:1787580062.009175:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239692160 00000100:00100000:1.0:1787580062.009266:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 38 00000100:00100000:1.0:1787580062.009278:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74ed1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+9:10334:x1874413239692160:12345-192.168.202.36@tcp:101:lctl.0 00010000:00010000:1.0:1787580062.009303:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787580062.009328:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58600/0xc86deac2083379e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d0d6 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580062.009422:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58a00/0xc86deac2083379e8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580062.009436:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58a00/0xc86deac2083379e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580062.009447:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58a00/0xc86deac2083379e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787580062.009510:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787580062.009514:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1787580062.009557:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58a00/0xc86deac2083379e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580062.009597:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58600/0xc86deac2083379e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d0d6 expref: 11 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580062.009614:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58a00/0xc86deac2083379e8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d0d6 expref: 10 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580062.009622:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fae5bb2ff00) 00010000:00010000:1.0:1787580062.009625:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787580062.009629:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae4ca58a00, rc 0) 00000100:00100000:1.0:1787580062.009699:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74ed1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+10:10334:x1874413239692160:12345-192.168.202.36@tcp:101:lctl.0 Request processed in 424us (903us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580062.009706:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 38 00000100:00100000:3.0:1787580062.098377:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580062.102852:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239692288 00000100:00100000:1.0:1787580062.102870:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239692288 00000100:00100000:1.0:1787580062.102949:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 39 00000100:00100000:1.0:1787580062.102963:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74ed3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+10:10340:x1874413239692288:12345-192.168.202.36@tcp:101:bash.0 00010000:00010000:1.0:1787580062.102984:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787580062.103007:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58200/0xc86deac2083379ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d0dd expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580062.103092:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58600/0xc86deac2083379f6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580062.103108:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58600/0xc86deac2083379f6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580062.103130:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58600/0xc86deac2083379f6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580062.103160:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac2083379fd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580062.103168:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac2083379fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580062.103176:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac2083379fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580062.103315:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58800/0xc86deac208337a04 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580062.103324:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58800/0xc86deac208337a04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580062.103332:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58800/0xc86deac208337a04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787580062.103367:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:1.0:1787580062.103370:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787580062.103442:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58800/0xc86deac208337a04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580062.103455:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58600/0xc86deac2083379f6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580062.103462:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58600/0xc86deac2083379f6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580062.103469:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58600/0xc86deac2083379f6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580062.103501:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae4ca58600 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:1.0:1787580062.103506:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58600/0xc86deac2083379f6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580062.103514:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58600/0xc86deac2083379f6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580062.103529:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fae5bb2ff00) 00010000:00010000:1.0:1787580062.103533:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787580062.103538:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58600/0xc86deac2083379f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580062.103544:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58600/0xc86deac2083379f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580062.103562:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac2083379fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580062.103568:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac2083379fd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580062.103574:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac2083379fd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580062.103580:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae4ca59200 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:1.0:1787580062.103584:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac2083379fd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580062.103590:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac2083379fd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580062.103611:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8fae5bb2f400) 00010000:00010000:1.0:1787580062.103614:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787580062.103618:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac2083379fd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580062.103624:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac2083379fd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580062.103837:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58200/0xc86deac2083379ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d0dd expref: 12 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580062.103857:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58800/0xc86deac208337a04 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d0dd expref: 11 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580062.103866:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8fae5bb2f900) 00010000:00010000:1.0:1787580062.103869:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787580062.103873:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae4ca58800, rc 0) 00000100:00100000:1.0:1787580062.103945:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74ed3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+11:10340:x1874413239692288:12345-192.168.202.36@tcp:101:bash.0 Request processed in 985us (5579us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580062.103955:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 39 00000100:00100000:0.0:1787580062.130903:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580062.141758:0:8897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239692544 00000100:00100000:3.0:1787580062.141774:0:8897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239692544 00000100:00100000:0.0:1787580062.142266:0:8897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 40 00000100:00100000:0.0:1787580062.142279:0:8897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7f35f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+11:10340:x1874413239692544:12345-192.168.202.36@tcp:101:bash.0 00010000:00010000:0.0:1787580062.142302:0:8897:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787580062.142335:0:8897:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea000/0xc86deac208337a0b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d0e4 expref: -99 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580062.142759:0:8897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea400/0xc86deac208337a12 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580062.142775:0:8897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea400/0xc86deac208337a12 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580062.142794:0:8897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea400/0xc86deac208337a12 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580062.143106:0:8897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb800/0xc86deac208337a19 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580062.143116:0:8897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb800/0xc86deac208337a19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580062.143306:0:8897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb800/0xc86deac208337a19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787580062.143978:0:8897:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:0.0:1787580062.151113:0:8897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac208337a20 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580062.151153:0:8897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac208337a20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580062.151169:0:8897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac208337a20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580062.151221:0:8897:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea400/0xc86deac208337a12 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580062.151229:0:8897:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea400/0xc86deac208337a12 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580062.151237:0:8897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea400/0xc86deac208337a12 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580062.151243:0:8897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae50fea400 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:0.0:1787580062.151257:0:8897:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea400/0xc86deac208337a12 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580062.151265:0:8897:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea400/0xc86deac208337a12 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580062.151284:0:8897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8fae5bb2f900) 00010000:00010000:0.0:1787580062.151288:0:8897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787580062.151294:0:8897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea400/0xc86deac208337a12 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580062.151300:0:8897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea400/0xc86deac208337a12 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787580062.151318:0:8897:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d0882569 reply state 0000000042067e86 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb800/0xc86deac208337a19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580062.151327:0:8897:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787580062.151404:0:8897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea000/0xc86deac208337a0b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d0e4 expref: 14 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580062.151420:0:8897:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac208337a20 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d0e4 expref: 13 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580062.151427:0:8897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8fae56e35300) 00010000:00010000:0.0:1787580062.151429:0:8897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787580062.151433:0:8897:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae50feb600, rc 0) 00000100:00100000:0.0:1787580062.151547:0:8897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7f35f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+14:10340:x1874413239692544:12345-192.168.202.36@tcp:101:bash.0 Request processed in 9269us (20652us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1787580062.151557:0:8897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 40 00010000:00010000:0.0:1787580062.156777:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb800/0xc86deac208337a19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580062.156795:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb800/0xc86deac208337a19 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580062.156802:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb800/0xc86deac208337a19 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580062.156819:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae50feb800 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:0.0:1787580062.156824:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb800/0xc86deac208337a19 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580062.156834:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb800/0xc86deac208337a19 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580062.156855:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8fae56e35400) 00010000:00010000:0.0:1787580062.156859:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787580062.156871:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb800/0xc86deac208337a19 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580062.156878:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb800/0xc86deac208337a19 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580062.158185:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580062.168158:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239692672 00000100:00100000:2.0:1787580062.168176:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239692672 00000100:00100000:1.0:1787580062.168359:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 20 00000100:00100000:1.0:1787580062.168370:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74ed0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2357:x1874413239692672:12345-192.168.202.36@tcp:8:bash.0 00010000:00080000:1.0:1787580062.168438:0:6707:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 31d1df27-21ab-4c76-bd19-e53fa778bd7e@192.168.202.36@tcp t0 exp 0000000000000000 cur 409 last 0 00000020:00000080:1.0:1787580062.168472:0:6707:0:(genops.c:1385:class_connect()) connect: client 31d1df27-21ab-4c76-bd19-e53fa778bd7e, cookie 0xc86deac208337a2e 00002000:00100000:1.0:1787580062.168487:0:6707:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 31d1df27-21ab-4c76-bd19-e53fa778bd7e/ffff8fae6d1e3000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787580062.168513:0:6707:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787580062.168945:0:6707:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787580062.168982:0:6707:0:(import.c:65:import_set_state_nolock()) ffff8fae6d4a0000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787580062.169095:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74ed0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:2357:x1874413239692672:12345-192.168.202.36@tcp:8:bash.0 Request processed in 724us (10916us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580062.169105:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 20 00000100:00100000:3.0:1787580062.187127:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580062.187330:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239692800 00000100:00100000:2.0:1787580062.187343:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239692800 00000100:00100000:2.0:1787580062.187463:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 21 00000100:00100000:2.0:1787580062.187476:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74ed3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:0:x1874413239692800:12345-192.168.202.36@tcp:101:bash.0 00010000:00010000:2.0:1787580062.187498:0:6705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787580062.187528:0:6705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6b004f7/0xc86deac208337a35 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d0eb expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787580062.187556:0:6705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787580062.187577:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=409s v=(0 0) 00010000:00010000:2.0:1787580062.187600:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787580062.187609:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6b004f7/0xc86deac208337a35 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d0eb expref: 7 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580062.187645:0:6705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6b004f7/0xc86deac208337a35 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d0eb expref: 7 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580062.187663:0:6705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae48db8800, rc 0) 00000100:00100000:2.0:1787580062.188006:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74ed3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+7:0:x1874413239692800:12345-192.168.202.36@tcp:101:bash.0 Request processed in 532us (892us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580062.188015:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 21 00000100:00080000:3.0:1787580062.188117:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787580062.195759:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787580062.206790:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580062.207235:0:10268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239692928 00000100:00100000:3.0:1787580062.207249:0:10268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239692928 00000100:00100000:3.0:1787580062.207319:0:10268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 22 00000100:00100000:3.0:1787580062.207330:0:10268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5f6fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+7:10340:x1874413239692928:12345-192.168.202.36@tcp:101:bash.0 00010000:00010000:3.0:1787580062.207350:0:10268:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787580062.207375:0:10268:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b8b516d/0xc86deac208337a3c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d0f2 expref: -99 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580062.207474:0:10268:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6b004f7/0xc86deac208337a35 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d0eb expref: 8 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580062.207483:0:10268:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787580062.207488:0:10268:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787580062.207493:0:10268:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b8b516d/0xc86deac208337a3c lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d0f2 expref: 8 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580062.207533:0:10268:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d6b004f7/0xc86deac208337a35 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d0eb expref: 8 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580062.207548:0:10268:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d6b004f7/0xc86deac208337a35 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d0eb expref: 8 pid: 6705 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580062.207563:0:10268:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae74ed3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10268:1874413262798080:192.168.202.36@tcp:104: 00000100:00100000:3.0:1787580062.208323:0:10268:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae48da3c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787580062.220075:0:10268:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae74ed3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10268:1874413262798080:192.168.202.36@tcp:104: 00010000:00010000:3.0:1787580062.220116:0:10268:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006b8b516d/0xc86deac208337a3c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d0f2 expref: 8 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580062.220139:0:10268:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae4150ee00, rc 0) 00000100:00100000:3.0:1787580062.220213:0:10268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5f6fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+8:10340:x1874413239692928:12345-192.168.202.36@tcp:101:bash.0 Request processed in 12884us (13434us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580062.220222:0:10268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 22 00000100:00100000:1.0:1787580062.227284:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580062.227552:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239693056 00000100:00100000:3.0:1787580062.227567:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239693056 00010000:00010000:3.0:1787580062.227631:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d6b004f7/0xc86deac208337a35 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d0eb expref: 8 pid: 6705 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580062.227683:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 35 00000100:00100000:3.0:1787580062.227695:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d661180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+8:2360:x1874413239693056:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787580062.227715:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787580062.227742:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d6b004f7/0xc86deac208337a35 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d0eb expref: 8 pid: 6705 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580062.227758:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d6b004f7/0xc86deac208337a35 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d0eb expref: 8 pid: 6705 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580062.227788:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6b004f7/0xc86deac208337a35 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d0eb expref: 8 pid: 6705 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580062.227809:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787580062.227814:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787580062.227824:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006b8b516d/0xc86deac208337a3c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d0f2 expref: 7 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580062.227836:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b8b516d/0xc86deac208337a3c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d0f2 expref: 7 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580062.227893:0:5839:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000006b8b516d/0xc86deac208337a3c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d0f2 expref: 7 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580062.227933:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae74ed3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5839:1874413262798208:192.168.202.36@tcp:105: 00000100:00100000:3.0:1787580062.228028:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae48da3c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787580062.233270:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae74ed3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5839:1874413262798208:192.168.202.36@tcp:105: 00010000:00010000:3.0:1787580062.233309:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787580062.233430:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d661180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+7:2360:x1874413239693056:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 5735us (6155us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580062.233443:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 35 00000100:00100000:0.0:1787580062.239542:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580062.239649:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239693312 00000100:00100000:3.0:1787580062.239662:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239693312 00000100:00100000:3.0:1787580062.239726:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 6 00000100:00100000:3.0:1787580062.239736:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7f35c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+13:10340:x1874413239693312:12345-192.168.202.36@tcp:35:bash.0 00000100:00100000:3.0:1787580062.240519:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7f35c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+14:10340:x1874413239693312:12345-192.168.202.36@tcp:35:bash.0 Request processed in 779us (983us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1787580062.240530:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 6 00000100:00100000:1.0:1787580062.374771:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580062.374886:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239693568 00000100:00100000:0.0:1787580062.374929:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239693568 00000100:00100000:0.0:1787580062.375005:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 41 00000100:00100000:0.0:1787580062.375016:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d661c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+14:10350:x1874413239693568:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:0.0:1787580062.375052:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787580062.375074:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea400/0xc86deac208337a43 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d0f9 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787580062.375219:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1787580062.375351:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea400/0xc86deac208337a43 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d0f9 expref: 16 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580062.375377:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fae5bb2ff00) 00010000:00010000:0.0:1787580062.375380:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787580062.375417:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea400/0xc86deac208337a43 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d0f9 expref: 16 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580062.375434:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae50fea400, rc 0) 00000100:00100000:0.0:1787580062.375505:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d661c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+15:10350:x1874413239693568:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 491us (748us total) trans 4294967313 rc 301/301 00000100:00100000:0.0:1787580062.375514:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 41 00000100:00100000:2.0:1787580062.379978:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580062.380072:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239693824 00000100:00100000:1.0:1787580062.380084:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239693824 00000100:00100000:1.0:1787580062.380147:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 7 00000100:00100000:1.0:1787580062.380159:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5f6ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+15:10350:x1874413239693824:12345-192.168.202.36@tcp:35:lfs.0 00000100:00100000:1.0:1787580062.380500:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5f6ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+16:10350:x1874413239693824:12345-192.168.202.36@tcp:35:lfs.0 Request processed in 342us (532us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1787580062.380509:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 7 00000100:00100000:3.0:1787580062.479313:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580062.479374:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239693952 00000100:00100000:1.0:1787580062.479414:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239693952 00000100:00100000:1.0:1787580062.479529:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 42 00000100:00100000:1.0:1787580062.479540:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74ed3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+16:10356:x1874413239693952:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:1.0:1787580062.479574:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787580062.479596:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58600/0xc86deac208337a51 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d100 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580062.479669:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac208337a58 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580062.479689:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac208337a58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580062.479703:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac208337a58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787580062.479766:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:1.0:1787580062.479771:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787580062.479813:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac208337a58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580062.479840:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58600/0xc86deac208337a51 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d100 expref: 18 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580062.479858:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac208337a58 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d100 expref: 17 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580062.479866:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8fae5bb2f900) 00010000:00010000:1.0:1787580062.479869:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787580062.479872:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae4ca59200, rc 0) 00000100:00100000:1.0:1787580062.479937:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74ed3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+17:10356:x1874413239693952:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 399us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580062.479942:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 42 00000100:00100000:3.0:1787580062.483486:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580062.483647:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239694208 00000100:00100000:0.0:1787580062.483658:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239694208 00000100:00100000:0.0:1787580062.483723:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 43 00000100:00100000:0.0:1787580062.483893:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74ed1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+17:10356:x1874413239694208:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:0.0:1787580062.483915:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787580062.483934:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea400/0xc86deac208337a5f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d107 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580062.484069:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb000/0xc86deac208337a66 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580062.484157:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb000/0xc86deac208337a66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580062.484170:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb000/0xc86deac208337a66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787580062.484183:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787580062.484312:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea400/0xc86deac208337a5f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d107 expref: 20 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580062.484331:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb000/0xc86deac208337a66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d107 expref: 19 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580062.484339:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8fae56e35300) 00010000:00010000:0.0:1787580062.484341:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787580062.484345:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae50feb000, rc 0) 00000100:00100000:0.0:1787580062.484443:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74ed1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+19:10356:x1874413239694208:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 712us (964us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1787580062.484451:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 43 00000100:00100000:2.0:1787580062.488130:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580062.489432:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580062.489596:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239694592 00000100:00100000:2.0:1787580062.489606:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239694592 00000100:00100000:2.0:1787580062.489672:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 2 00000100:00100000:2.0:1787580062.489683:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74ed2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+19:2361:x1874413239694592:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787580062.489699:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787580062.489724:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb000/0xc86deac208337a66 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d107 expref: 19 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580062.489745:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8fae56e35300) 00010000:00010000:2.0:1787580062.489750:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787580062.489809:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74ed2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+18:2361:x1874413239694592:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 127us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580062.489817:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 2 00000100:00100000:0.0:1787580062.490331:0:8897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239694464 00000100:00100000:0.0:1787580062.490338:0:8897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239694464 00000100:00100000:0.0:1787580062.490409:0:8897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 44 00000100:00100000:0.0:1787580062.490418:0:8897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5f6fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+18:10356:x1874413239694464:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:0.0:1787580062.490438:0:8897:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787580062.490461:0:8897:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feaa00/0xc86deac208337a74 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d10e expref: -99 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580062.490860:0:8897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feac00/0xc86deac208337a7b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580062.490875:0:8897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feac00/0xc86deac208337a7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580062.490886:0:8897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feac00/0xc86deac208337a7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787580062.490897:0:8897:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787580062.491020:0:8897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feaa00/0xc86deac208337a74 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d10e expref: 21 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580062.491048:0:8897:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feac00/0xc86deac208337a7b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d10e expref: 20 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580062.491056:0:8897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8fae56e35300) 00010000:00010000:0.0:1787580062.491060:0:8897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787580062.491062:0:8897:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae50feac00, rc 0) 00000100:00100000:0.0:1787580062.491228:0:8897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5f6fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+20:10356:x1874413239694464:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 811us (3109us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1787580062.491237:0:8897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 44 00000100:00100000:3.0:1787580062.500841:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580062.500898:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239694720 00000100:00100000:0.0:1787580062.500909:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239694720 00000100:00100000:0.0:1787580062.501014:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 23 00000100:00100000:0.0:1787580062.501025:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74ed2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+7:2358:x1874413239694720:12345-192.168.202.36@tcp:1:lfs.0 00010000:00010000:0.0:1787580062.501163:0:6708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a82957ec/0xc86deac208337a89 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580062.501186:0:6708:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006b8b516d/0xc86deac208337a3c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d0f2 expref: 7 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580062.501194:0:6708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1787580062.501198:0:6708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787580062.501202:0:6708:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a82957ec/0xc86deac208337a89 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580062.501239:0:6708:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006b8b516d/0xc86deac208337a3c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d0f2 expref: 7 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580062.501253:0:6708:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006b8b516d/0xc86deac208337a3c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d0f2 expref: 7 pid: 10268 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580062.501267:0:6708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7f35ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6708:1874413262798336:192.168.202.36@tcp:104: 00000100:00100000:0.0:1787580062.501363:0:6708:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae4722d840 going to sleep for 11 seconds 00000100:00100000:2.0:1787580062.506808:0:6708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7f35ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6708:1874413262798336:192.168.202.36@tcp:104: 00000100:00100000:0.0:1787580062.506808:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00010000:00010000:2.0:1787580062.506836:0:6708:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a82957ec/0xc86deac208337a89 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580062.506906:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239694848 00000100:00100000:3.0:1787580062.506914:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239694848 00002000:00100000:3.0:1787580062.506972:0:6711:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff8fae7f35ea00 x1874413239694848/t0(0) o4->31d1df27-21ab-4c76-bd19-e53fa778bd7e@192.168.202.36@tcp:548/0 lens 504/0 e 0 to 0 dl 1787580073 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787580062.506982:0:6711:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8fae7f35ea00 with x1874413239694848 ext(0->12) 00010000:00010000:3.0:1787580062.506989:0:6711:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000006b8b516d/0xc86deac208337a3c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d0f2 expref: 8 pid: 10268 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580062.507017:0:6711:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000006b8b516d/0xc86deac208337a3c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d0f2 expref: 8 pid: 10268 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787580062.507025:0:6711:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8fae7f35ea00 00000100:00100000:3.0:1787580062.507064:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 0 00000100:00100000:3.0:1787580062.507082:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7f35ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+8:2361:x1874413239694848:12345-192.168.202.36@tcp:4:lfs.0 00000001:00100000:2.0:1787580062.587521:0:6733:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 31d1df27-21ab-4c76-bd19-e53fa778bd7e 00000100:00100000:3.0:1787580062.588808:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7f35ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+9:2361:x1874413239694848:12345-192.168.202.36@tcp:4:lfs.0 Request processed in 81728us (82002us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1787580062.588822:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 0 00002000:00100000:3.0:1787580062.588835:0:6711:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff8fae7f35ea00 x1874413239694848/t4294967299(0) o4->31d1df27-21ab-4c76-bd19-e53fa778bd7e@192.168.202.36@tcp:548/0 lens 504/448 e 0 to 0 dl 1787580073 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787580062.588846:0:6711:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8fae7f35ea00 with x1874413239694848 ext(0->12) 00010000:00010000:3.0:1787580062.588869:0:6711:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000006b8b516d/0xc86deac208337a3c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d0f2 expref: 9 pid: 10268 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580062.588889:0:6711:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000006b8b516d/0xc86deac208337a3c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d0f2 expref: 9 pid: 10268 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787580062.588898:0:6711:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8fae7f35ea00 00000100:00100000:3.0:1787580062.592446:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580062.592643:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239694976 00000100:00100000:2.0:1787580062.592653:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239694976 00010000:00010000:2.0:1787580062.592697:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006b8b516d/0xc86deac208337a3c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d0f2 expref: 9 pid: 10268 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580062.592755:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 36 00000100:00100000:2.0:1787580062.592769:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74ed1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+9:2358:x1874413239694976:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787580062.592785:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1787580062.592810:0:5839:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1787580062.592813:0:5839:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1787580062 00002000:00010000:2.0:1787580062.592816:0:5839:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1787580062 00002000:00010000:2.0:1787580062.592818:0:5839:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1787580062 00010000:00010000:2.0:1787580062.592824:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006b8b516d/0xc86deac208337a3c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d0f2 expref: 9 pid: 10268 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580062.592838:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006b8b516d/0xc86deac208337a3c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d0f2 expref: 9 pid: 10268 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580062.593129:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b8b516d/0xc86deac208337a3c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d0f2 expref: 9 pid: 10268 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580062.593172:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787580062.593176:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787580062.593188:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a82957ec/0xc86deac208337a89 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580062.593199:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a82957ec/0xc86deac208337a89 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580062.593299:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787580062.593420:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74ed1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+8:2358:x1874413239694976:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 616us (947us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580062.593435:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 36 00010000:00010000:0.0:1787580062.594629:0:6708:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a82957ec/0xc86deac208337a89 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580062.594645:0:6708:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a82957ec/0xc86deac208337a89 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580062.594702:0:6708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a82957ec/0xc86deac208337a89 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580062.594716:0:6708:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a82957ec/0xc86deac208337a89 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580062.594725:0:6708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a82957ec/0xc86deac208337a89 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580062.594786:0:6708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae50feaa00 already unused, calling callback (ffffffffc155a230) 00010000:00010000:0.0:1787580062.594791:0:6708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a82957ec/0xc86deac208337a89 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580062.594801:0:6708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a82957ec/0xc86deac208337a89 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580062.594818:0:6708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a82957ec/0xc86deac208337a89 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580062.594826:0:6708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a82957ec/0xc86deac208337a89 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580062.595131:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74ed2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+7:2358:x1874413239694720:12345-192.168.202.36@tcp:1:lfs.0 Request processed in 94104us (94294us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580062.595141:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 23 00000100:00100000:3.0:1787580062.599719:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580062.599832:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239695232 00000100:00100000:0.0:1787580062.599842:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239695232 00000100:00100000:0.0:1787580062.599926:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 8 00000100:00100000:0.0:1787580062.599945:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74ed1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+20:10356:x1874413239695232:12345-192.168.202.36@tcp:35:lfs.0 00000004:00010000:0.0:1787580062.600049:0:5855:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feac00/0xc86deac208337a7b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d10e expref: 20 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787580062.600425:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:0.0:1787580062.600487:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:0.0:1787580062.601138:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:0.0:1787580062.601206:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea400/0xc86deac208337a90 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580062.601224:0:5855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac208337a20 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d0e4 expref: 24 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580062.601233:0:5855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea400/0xc86deac208337a90 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580062.601271:0:5855:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac208337a20 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d0e4 expref: 24 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580062.601288:0:5855:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac208337a20 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d0e4 expref: 24 pid: 8897 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580062.601313:0:5855:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7f35ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5855:1874413262798464:192.168.202.36@tcp:104: 00000100:00100000:0.0:1787580062.601450:0:5855:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae48da3480 going to sleep for 11 seconds 00000100:00100000:0.0:1787580062.606634:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580062.606785:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239695360 00000100:00100000:2.0:1787580062.606795:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239695360 00010000:00010000:2.0:1787580062.606847:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac208337a20 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d0e4 expref: 25 pid: 8897 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580062.606974:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 37 00000100:00100000:2.0:1787580062.606990:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7f35dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+25:2360:x1874413239695360:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787580062.607006:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787580062.607497:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac208337a20 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d0e4 expref: 25 pid: 8897 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580062.607512:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac208337a20 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d0e4 expref: 25 pid: 8897 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580062.607575:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8fae56e35300) 00010000:00010000:2.0:1787580062.607581:0:5840:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea400/0xc86deac208337a90 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580062.607589:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea400/0xc86deac208337a90 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580062.607601:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea400/0xc86deac208337a90 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580062.607618:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787580062.607687:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7f35dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+25:2360:x1874413239695360:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 693us (1058us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580062.607694:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 37 00010000:00010000:3.0:1787580062.607991:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac208337a20 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d0e4 expref: 24 pid: 8897 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580062.608033:0:5855:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7f35ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5855:1874413262798464:192.168.202.36@tcp:104: 00010000:00010000:3.0:1787580062.608061:0:5855:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea400/0xc86deac208337a90 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580062.608069:0:5855:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea400/0xc86deac208337a90 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580062.608074:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea400/0xc86deac208337a90 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787580062.608215:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:3.0:1787580062.608472:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:3.0:1787580062.608602:0:5855:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae74ed2a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5855:1874413262798592:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787580062.608660:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580062.608690:0:5855:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fad418efa80 going to sleep for 11 seconds 00000100:00100000:3.0:1787580062.608720:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262798592 00000100:00100000:3.0:1787580062.608725:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262798592 00000100:00100000:3.0:1787580062.608772:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787580062.608783:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5855:x1874413262798592:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787580062.608865:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5855:x1874413262798592:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 83us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580062.608873:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1787580062.608893:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787580062.608921:0:5855:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae74ed2a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5855:1874413262798592:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787580062.609674:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:3.0:1787580062.609767:0:5855:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae48c90700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5855:1874413262798720:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787580062.609824:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580062.609854:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262798720 00000100:00100000:3.0:1787580062.609860:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262798720 00000100:00100000:3.0:1787580062.609890:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787580062.609899:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5855:x1874413262798720:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787580062.610052:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5855:x1874413262798720:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 153us (227us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1787580062.610060:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787580062.610210:0:5855:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae436f8300 going to sleep for 11 seconds 00000100:00100000:3.0:1787580062.610236:0:5855:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae48c90700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5855:1874413262798720:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787580062.610282:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:3.0:1787580062.610318:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea400/0xc86deac208337a90 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580062.610327:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea400/0xc86deac208337a90 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580062.610334:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea400/0xc86deac208337a90 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580062.610339:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae50fea400 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:3.0:1787580062.610344:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea400/0xc86deac208337a90 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580062.610350:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea400/0xc86deac208337a90 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580062.610364:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8fae56e35300) 00010000:00010000:3.0:1787580062.610367:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787580062.610379:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea400/0xc86deac208337a90 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580062.610409:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea400/0xc86deac208337a90 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787580062.610578:0:5855:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787580062.610786:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:3.0:1787580062.610800:0:5855:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 410366416184ns, next at 411366413654ns, rc = 0 00000001:00080000:3.0:1787580062.610808:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:3.0:1787580062.610840:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8fae56e35300) 00010000:00010000:3.0:1787580062.610844:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787580062.610852:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feac00/0xc86deac208337a7b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d10e expref: 28 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580062.610993:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74ed1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+27:10356:x1874413239695232:12345-192.168.202.36@tcp:35:lfs.0 Request processed in 11051us (11289us total) trans 4294967325 rc 0/0 00000100:00100000:3.0:1787580062.611003:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 8 00000020:00080000:3.0:1787580062.611006:0:5855:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1787580062.617577:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580062.617650:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239695488 00000100:00100000:1.0:1787580062.617660:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239695488 00000100:00100000:1.0:1787580062.617723:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 45 00000100:00100000:1.0:1787580062.617734:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74ed2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+27:10356:x1874413239695488:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:1.0:1787580062.617760:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787580062.617786:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58000/0xc86deac208337a97 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d115 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580062.617848:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58000/0xc86deac208337a97 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d115 expref: 28 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580062.617874:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58000/0xc86deac208337a97 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d115 expref: 28 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580062.617914:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8fae5bb2f400) 00010000:00010000:1.0:1787580062.617917:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787580062.617920:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae4ca58000, rc 0) 00000100:00100000:1.0:1787580062.618329:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74ed2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+28:10356:x1874413239695488:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 596us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580062.618337:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 45 00000100:00100000:3.0:1787580062.622568:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580062.622933:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239695744 00000100:00100000:1.0:1787580062.622945:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239695744 00000100:00100000:1.0:1787580062.623216:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 9 00000100:00100000:1.0:1787580062.623227:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51884450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+28:10356:x1874413239695744:12345-192.168.202.36@tcp:35:lfs.0 00000100:00100000:1.0:1787580062.623518:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51884450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+29:10356:x1874413239695744:12345-192.168.202.36@tcp:35:lfs.0 Request processed in 291us (961us total) trans 4294967326 rc 0/0 00000100:00100000:1.0:1787580062.623525:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 9 00000100:00100000:0.0:1787580062.730556:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580062.730683:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239696000 00000100:00100000:1.0:1787580062.730695:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239696000 00000100:00100000:1.0:1787580062.730766:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 46 00000100:00100000:1.0:1787580062.730776:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7f35c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+29:10366:x1874413239696000:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:1.0:1787580062.730804:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787580062.730826:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58200/0xc86deac208337a9e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d11c expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787580062.731192:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1787580062.731318:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58200/0xc86deac208337a9e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d11c expref: 31 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580062.731348:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fae5bb2ff00) 00010000:00010000:1.0:1787580062.731351:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787580062.731357:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58200/0xc86deac208337a9e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d11c expref: 31 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580062.731371:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae4ca58200, rc 0) 00000100:00100000:1.0:1787580062.731663:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7f35c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+30:10366:x1874413239696000:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 888us (1119us total) trans 4294967327 rc 301/301 00000100:00100000:1.0:1787580062.731671:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 46 00000100:00100000:0.0:1787580062.736187:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580062.736293:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239696128 00000100:00100000:2.0:1787580062.736304:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239696128 00000100:00100000:2.0:1787580062.736419:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 47 00000100:00100000:2.0:1787580062.736429:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7f35ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+30:10366:x1874413239696128:12345-192.168.202.36@tcp:34:lfs.0 00010000:00010000:2.0:1787580062.736516:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208337aac lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580062.736534:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208337aac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580062.736547:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208337aac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580062.736562:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8400/0xc86deac208337ab3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580062.736581:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8400/0xc86deac208337ab3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580062.736589:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8400/0xc86deac208337ab3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580062.736695:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9a00/0xc86deac208337aba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580062.736704:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9a00/0xc86deac208337aba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580062.736711:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9a00/0xc86deac208337aba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787580062.737063:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9a00/0xc86deac208337aba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580062.737078:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208337aac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580062.737085:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208337aac lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580062.737093:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208337aac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580062.737098:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db9000 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:2.0:1787580062.737102:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208337aac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580062.737110:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208337aac lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580062.737132:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8fae5bb2f900) 00010000:00010000:2.0:1787580062.737135:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787580062.737140:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208337aac lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580062.737147:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208337aac lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580062.737162:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8400/0xc86deac208337ab3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580062.737168:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8400/0xc86deac208337ab3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580062.737173:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8400/0xc86deac208337ab3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580062.737178:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db8400 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:2.0:1787580062.737180:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8400/0xc86deac208337ab3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580062.737186:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8400/0xc86deac208337ab3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580062.737192:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8fae4c7d9f00) 00010000:00010000:2.0:1787580062.737194:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787580062.737196:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8400/0xc86deac208337ab3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580062.737201:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8400/0xc86deac208337ab3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580062.737228:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9a00/0xc86deac208337aba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580062.737234:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9a00/0xc86deac208337aba lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580062.737240:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9a00/0xc86deac208337aba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580062.737245:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db9a00 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:2.0:1787580062.737248:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9a00/0xc86deac208337aba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580062.737254:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9a00/0xc86deac208337aba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580062.737262:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8fae5bb2f400) 00010000:00010000:2.0:1787580062.737264:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787580062.737267:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9a00/0xc86deac208337aba lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580062.737272:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9a00/0xc86deac208337aba lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580062.737469:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7f35ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+30:10366:x1874413239696128:12345-192.168.202.36@tcp:34:lfs.0 Request processed in 1037us (1289us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580062.737478:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 47 00000100:00100000:1.0:1787580062.742069:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580062.742164:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239696384 00000100:00100000:2.0:1787580062.742175:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239696384 00000100:00100000:2.0:1787580062.742258:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 10 00000100:00100000:2.0:1787580062.742285:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d661500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+30:10366:x1874413239696384:12345-192.168.202.36@tcp:35:lfs.0 00000100:00100000:2.0:1787580062.742631:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d661500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+31:10366:x1874413239696384:12345-192.168.202.36@tcp:35:lfs.0 Request processed in 347us (570us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1787580062.742640:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 10 00000100:00100000:0.0:1787580062.775909:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580062.776044:0:8897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239696640 00000100:00100000:2.0:1787580062.776055:0:8897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239696640 00000100:00100000:2.0:1787580062.776123:0:8897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 48 00000100:00100000:2.0:1787580062.776135:0:8897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5f812300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+31:10369:x1874413239696640:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:2.0:1787580062.776164:0:8897:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787580062.776188:0:8897:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9a00/0xc86deac208337ac1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d123 expref: -99 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580062.776267:0:8897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8400/0xc86deac208337ac8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580062.776281:0:8897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8400/0xc86deac208337ac8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580062.776291:0:8897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8400/0xc86deac208337ac8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580062.776305:0:8897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208337acf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580062.776313:0:8897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208337acf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580062.776319:0:8897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208337acf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580062.776517:0:8897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8a00/0xc86deac208337ad6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580062.776527:0:8897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8a00/0xc86deac208337ad6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580062.776534:0:8897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8a00/0xc86deac208337ad6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787580062.776544:0:8897:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787580062.776649:0:8897:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8400/0xc86deac208337ac8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580062.776656:0:8897:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8400/0xc86deac208337ac8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580062.776662:0:8897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8400/0xc86deac208337ac8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580062.776667:0:8897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db8400 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:2.0:1787580062.776671:0:8897:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8400/0xc86deac208337ac8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580062.776678:0:8897:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8400/0xc86deac208337ac8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580062.776689:0:8897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8fae5bb2f900) 00010000:00010000:2.0:1787580062.776692:0:8897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787580062.776696:0:8897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8400/0xc86deac208337ac8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580062.776712:0:8897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8400/0xc86deac208337ac8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580062.776725:0:8897:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208337acf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580062.776731:0:8897:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208337acf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580062.776736:0:8897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208337acf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580062.776741:0:8897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db9000 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:2.0:1787580062.776744:0:8897:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208337acf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580062.776749:0:8897:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208337acf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580062.776756:0:8897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8fae4c7d9f00) 00010000:00010000:2.0:1787580062.776759:0:8897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787580062.776761:0:8897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208337acf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580062.776767:0:8897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208337acf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580062.776807:0:8897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9a00/0xc86deac208337ac1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d123 expref: 34 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580062.776820:0:8897:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8a00/0xc86deac208337ad6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d123 expref: 33 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580062.776832:0:8897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8fae5bb2f400) 00010000:00010000:2.0:1787580062.776834:0:8897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787580062.776837:0:8897:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae48db8a00, rc 0) 00000100:00100000:2.0:1787580062.776891:0:8897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5f812300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+33:10369:x1874413239696640:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 759us (993us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1787580062.776899:0:8897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 48 00000100:00100000:0.0:1787580062.781671:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580062.781764:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239696768 00000100:00100000:1.0:1787580062.781774:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239696768 00000100:00100000:1.0:1787580062.781833:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 49 00000100:00100000:1.0:1787580062.781844:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5f810700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+33:10369:x1874413239696768:12345-192.168.202.36@tcp:54:lfs.0 00010000:00010000:1.0:1787580062.781925:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58200/0xc86deac208337ae4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580062.781951:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58200/0xc86deac208337ae4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580062.781971:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58200/0xc86deac208337ae4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580062.782014:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58200/0xc86deac208337ae4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580062.782021:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58200/0xc86deac208337ae4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580062.782051:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58200/0xc86deac208337ae4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580062.782058:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae4ca58200 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:1.0:1787580062.782062:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58200/0xc86deac208337ae4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580062.782070:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58200/0xc86deac208337ae4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580062.782084:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8fae5bb2f400) 00010000:00010000:1.0:1787580062.782087:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787580062.782093:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58200/0xc86deac208337ae4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580062.782098:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58200/0xc86deac208337ae4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580062.782179:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5f810700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+33:10369:x1874413239696768:12345-192.168.202.36@tcp:54:lfs.0 Request processed in 336us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580062.782188:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 49 00000100:00100000:0.0:1787580062.784920:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580062.785018:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239697024 00000100:00100000:1.0:1787580062.785029:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239697024 00000100:00100000:1.0:1787580062.785095:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 11 00000100:00100000:1.0:1787580062.785106:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5f810e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+33:10369:x1874413239697024:12345-192.168.202.36@tcp:35:lfs.0 00000100:00100000:1.0:1787580062.785372:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5f810e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+34:10369:x1874413239697024:12345-192.168.202.36@tcp:35:lfs.0 Request processed in 266us (461us total) trans 4294967330 rc 0/0 00000100:00100000:1.0:1787580062.785405:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 11 00000001:00080000:2.0:1787580062.889644:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967320 is committed 00000001:00080000:2.0:1787580062.889677:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967330 is committed 00000004:00080000:2.0:1787580062.889700:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:2.0:1787580062.889727:0:5874:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8fad418efa80 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:2.0:1787580062.889732:0:5874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8fae50ff3f00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8fad418ef600 00000020:00080000:2.0:1787580062.889735:0:5874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8fae50ff3700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8fae7f142000 00000020:00080000:2.0:1787580062.889762:0:5885:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:2.0:1787580062.889909:0:5885:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:0.0:1787580062.890244:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787580062.890268:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5f811500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874413262798848:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787580062.890341:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580062.890430:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262798848 00000100:00100000:0.0:1787580062.890437:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262798848 00000100:00100000:0.0:1787580062.890484:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787580062.890492:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5f810a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3317:x1874413262798848:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1787580062.890543:0:6707:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:0.0:1787580062.890576:0:6707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a8c4e9e, atime: 0x6a8c4e9e, ctime: 0x6a8c4e9e, blocks: 0x1 00010000:00010000:0.0:1787580062.890584:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cbd83212/0xc86deac208337aeb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580062.890601:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=410s v=(0 0) 00010000:00010000:0.0:1787580062.890606:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787580062.890612:0:6707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cbd83212/0xc86deac208337aeb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580062.890626:0:6707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cbd83212/0xc86deac208337aeb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580062.890637:0:6707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cbd83212/0xc86deac208337aeb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580062.890674:0:6707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cbd83212/0xc86deac208337aeb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580062.890693:0:6707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787580062.891576:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5f810a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3317:x1874413262798848:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1080us (1232us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1787580062.891587:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1787580062.891618:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787580062.891627:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cbd83212/0xc86deac208337aeb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580062.891636:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae50febe00 already unused, calling callback (ffffffffc155a230) 00010000:00010000:0.0:1787580062.891641:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cbd83212/0xc86deac208337aeb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580062.891652:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cbd83212/0xc86deac208337aeb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580062.891671:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cbd83212/0xc86deac208337aeb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580062.891679:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cbd83212/0xc86deac208337aeb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580062.891697:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787580062.891707:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787580062.891709:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787580062.892231:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8fae5f811500/2, rc 0, transno 4294967301 00000100:00100000:2.0:1787580062.892241:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5f811500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874413262798848:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787580063.027834:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580063.031578:0:8897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239697280 00000100:00100000:2.0:1787580063.031596:0:8897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239697280 00000100:00100000:2.0:1787580063.031696:0:8897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 50 00000100:00100000:2.0:1787580063.031708:0:8897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5f811880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+12:10400:x1874413239697280:12345-192.168.202.36@tcp:101:cat.0 00010000:00010000:2.0:1787580063.031747:0:8897:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787580063.031773:0:8897:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9a00/0xc86deac208337af2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d12a expref: -99 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580063.031908:0:8897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208337af9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580063.031922:0:8897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208337af9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580063.031932:0:8897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208337af9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787580063.031943:0:8897:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787580063.032220:0:8897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9a00/0xc86deac208337af2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d12a expref: 15 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580063.032241:0:8897:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208337af9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d12a expref: 14 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580063.032250:0:8897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8fae5bb2f400) 00010000:00010000:2.0:1787580063.032253:0:8897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787580063.032257:0:8897:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae48db9000, rc 0) 00000100:00100000:2.0:1787580063.032325:0:8897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5f811880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+14:10400:x1874413239697280:12345-192.168.202.36@tcp:101:cat.0 Request processed in 618us (4599us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1787580063.032333:0:8897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 50 00000100:00080000:3.0:1787580063.032819:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787580063.038115:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580063.038269:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239697536 00000100:00100000:1.0:1787580063.038280:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239697536 00000100:00100000:1.0:1787580063.038341:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 12 00000100:00100000:1.0:1787580063.038352:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5f812a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+14:10400:x1874413239697536:12345-192.168.202.36@tcp:35:cat.0 00000100:00100000:1.0:1787580063.038642:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5f812a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+15:10400:x1874413239697536:12345-192.168.202.36@tcp:35:cat.0 Request processed in 292us (538us total) trans 4294967332 rc 0/0 00000100:00100000:1.0:1787580063.038650:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 12 00000100:00100000:0.0:1787580063.041710:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580063.041809:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239697664 00000100:00100000:2.0:1787580063.041819:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239697664 00000100:00100000:2.0:1787580063.041912:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 3 00000100:00100000:2.0:1787580063.041923:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae52136450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+15:2361:x1874413239697664:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787580063.041938:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787580063.041989:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208337af9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d12a expref: 15 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580063.042010:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8fae5bb2f400) 00010000:00010000:2.0:1787580063.042015:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787580063.042081:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae52136450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+14:2361:x1874413239697664:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 159us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580063.042088:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 3 00000100:00100000:0.0:1787580063.089488:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580063.089587:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239697920 00000100:00100000:1.0:1787580063.089599:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239697920 00000100:00100000:1.0:1787580063.089660:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 51 00000100:00100000:1.0:1787580063.089668:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5f811f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+14:10406:x1874413239697920:12345-192.168.202.36@tcp:101:dd.0 00010000:00010000:1.0:1787580063.089693:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787580063.089696:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787580063.089721:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac208337a58 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d100 expref: 14 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580063.089751:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8fae5bb2f900) 00010000:00010000:1.0:1787580063.089756:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787580063.089771:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58200/0xc86deac208337b07 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d131 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580063.089894:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58600/0xc86deac208337b0e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580063.089910:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8a00/0xc86deac208337ad6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d123 expref: 14 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580063.089919:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58600/0xc86deac208337b0e lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580063.089969:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8a00/0xc86deac208337ad6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d123 expref: 14 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580063.089988:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8a00/0xc86deac208337ad6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d123 expref: 14 pid: 8897 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580063.090003:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d661180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5854:1874413262798976:192.168.202.36@tcp:104: 00000100:00100000:1.0:1787580063.090104:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae77a2fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787580063.092218:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d661180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5854:1874413262798976:192.168.202.36@tcp:104: 00010000:00010000:1.0:1787580063.092248:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58600/0xc86deac208337b0e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580063.093952:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580063.094077:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239698048 00000100:00100000:2.0:1787580063.094087:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239698048 00010000:00010000:2.0:1787580063.094129:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8a00/0xc86deac208337ad6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d123 expref: 15 pid: 8897 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580063.094175:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 38 00000100:00100000:2.0:1787580063.094186:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae77a89f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+15:2361:x1874413239698048:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787580063.094203:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787580063.094211:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8a00/0xc86deac208337ad6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d123 expref: 15 pid: 8897 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580063.094223:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8a00/0xc86deac208337ad6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d123 expref: 15 pid: 8897 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580063.094246:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8a00/0xc86deac208337ad6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d123 expref: 15 pid: 8897 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580063.094263:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8fae5bb2f400) 00010000:00010000:2.0:1787580063.094268:0:5840:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58600/0xc86deac208337b0e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580063.094292:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58600/0xc86deac208337b0e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580063.094299:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58600/0xc86deac208337b0e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580063.094331:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787580063.094417:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae77a89f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+14:2361:x1874413239698048:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 232us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580063.094424:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 38 00010000:00010000:1.0:1787580063.094561:0:5854:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58600/0xc86deac208337b0e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580063.094571:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58600/0xc86deac208337b0e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787580063.094595:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787580063.094784:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58200/0xc86deac208337b07 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d131 expref: 15 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580063.094800:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58600/0xc86deac208337b0e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d131 expref: 14 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580063.094808:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8fae5bb2f400) 00010000:00010000:1.0:1787580063.094810:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787580063.094819:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae4ca58600, rc 0) 00000100:00100000:1.0:1787580063.094848:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5f811f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+14:10406:x1874413239697920:12345-192.168.202.36@tcp:101:dd.0 Request processed in 5180us (5374us total) trans 4294967333 rc 0/0 00000100:00100000:1.0:1787580063.094855:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 51 00000100:00100000:0.0:1787580063.099168:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580063.099294:0:8897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239698304 00000100:00100000:2.0:1787580063.099304:0:8897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239698304 00000100:00100000:2.0:1787580063.099365:0:8897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 52 00000100:00100000:2.0:1787580063.099419:0:8897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae77a88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+14:10406:x1874413239698304:12345-192.168.202.36@tcp:36:dd.0 00010000:00010000:2.0:1787580063.099740:0:8897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208337b1c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580063.099757:0:8897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208337b1c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580063.099767:0:8897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208337b1c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787580063.099818:0:8897:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:2.0:1787580063.099844:0:8897:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fea5b6bb reply state 00000000dfade083 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208337b1c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580063.099854:0:8897:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787580063.099941:0:8897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae77a88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+17:10406:x1874413239698304:12345-192.168.202.36@tcp:36:dd.0 Request processed in 566us (783us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1787580063.099964:0:8897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 52 00000020:00080000:2.0:1787580063.099979:0:8897:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787580063.107606:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208337b1c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580063.107626:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208337b1c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580063.107635:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208337b1c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580063.107642:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db9000 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:2.0:1787580063.107648:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208337b1c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580063.107655:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208337b1c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580063.107675:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8fae5bb2f400) 00010000:00010000:2.0:1787580063.107678:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787580063.107683:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208337b1c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580063.107691:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208337b1c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580063.219679:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787580063.390188:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580063.390296:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239698432 00000100:00100000:2.0:1787580063.390307:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239698432 00000100:00100000:2.0:1787580063.390407:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 53 00000100:00100000:2.0:1787580063.390420:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae77a89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+16:10420:x1874413239698432:12345-192.168.202.36@tcp:101:stat.0 00010000:00010000:2.0:1787580063.390461:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787580063.390483:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208337b23 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d138 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580063.390543:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8a00/0xc86deac208337b2a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580063.390557:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8a00/0xc86deac208337b2a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580063.390570:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8a00/0xc86deac208337b2a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580063.390583:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9a00/0xc86deac208337b31 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580063.390591:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9a00/0xc86deac208337b31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580063.390598:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9a00/0xc86deac208337b31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580063.390906:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8400/0xc86deac208337b38 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580063.390915:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58600/0xc86deac208337b0e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d131 expref: 17 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580063.390921:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8400/0xc86deac208337b38 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580063.390950:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58600/0xc86deac208337b0e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d131 expref: 17 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580063.390972:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58600/0xc86deac208337b0e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d131 expref: 17 pid: 5854 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580063.390985:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5f6ff800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5853:1874413262799104:192.168.202.36@tcp:104: 00000100:00100000:2.0:1787580063.391099:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae5f6f6900 going to sleep for 11 seconds 00000100:00100000:0.0:1787580063.401489:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580063.401765:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5f6ff800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5853:1874413262799104:192.168.202.36@tcp:104: 00010000:00010000:2.0:1787580063.401792:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8400/0xc86deac208337b38 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580063.403124:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239698688 00000100:00100000:1.0:1787580063.403136:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239698688 00000100:00100000:1.0:1787580063.403278:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 13 00000100:00100000:1.0:1787580063.403291:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae77a8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+18:5600:x1874413239698688:12345-192.168.202.36@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787580063.404444:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae77a8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+19:5600:x1874413239698688:12345-192.168.202.36@tcp:35:ldlm_bl.0 Request processed in 1144us (2954us total) trans 4294967336 rc 0/0 00000100:00100000:1.0:1787580063.404458:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 13 00000100:00100000:0.0:1787580063.409669:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580063.409773:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239698816 00000100:00100000:1.0:1787580063.409786:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239698816 00010000:00010000:1.0:1787580063.409832:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58600/0xc86deac208337b0e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d131 expref: 19 pid: 5854 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580063.409886:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 39 00000100:00100000:1.0:1787580063.409897:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae77a8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+19:2360:x1874413239698816:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787580063.409914:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787580063.409922:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58600/0xc86deac208337b0e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d131 expref: 19 pid: 5854 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580063.409936:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58600/0xc86deac208337b0e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d131 expref: 19 pid: 5854 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580063.409973:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58600/0xc86deac208337b0e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d131 expref: 19 pid: 5854 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580063.410007:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8fae5bb2f400) 00010000:00010000:1.0:1787580063.410013:0:5838:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8400/0xc86deac208337b38 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580063.410023:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8400/0xc86deac208337b38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580063.410042:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8400/0xc86deac208337b38 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580063.410076:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787580063.410146:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae77a8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+18:2360:x1874413239698816:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 250us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580063.410155:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 39 00010000:00010000:0.0:1787580063.410221:0:5853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8400/0xc86deac208337b38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580063.410229:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8400/0xc86deac208337b38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787580063.410278:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1787580063.410283:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787580063.410331:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8400/0xc86deac208337b38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580063.410345:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8400/0xc86deac208337b38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580063.410355:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8a00/0xc86deac208337b2a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580063.410361:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8a00/0xc86deac208337b2a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580063.410367:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8a00/0xc86deac208337b2a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580063.410403:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db8a00 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:0.0:1787580063.410409:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8a00/0xc86deac208337b2a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580063.410417:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8a00/0xc86deac208337b2a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580063.410428:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8fae5bb2f900) 00010000:00010000:0.0:1787580063.410430:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787580063.410434:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8a00/0xc86deac208337b2a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580063.410441:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8a00/0xc86deac208337b2a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580063.410454:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9a00/0xc86deac208337b31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580063.410460:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9a00/0xc86deac208337b31 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580063.410466:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9a00/0xc86deac208337b31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580063.410471:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db9a00 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:0.0:1787580063.410474:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9a00/0xc86deac208337b31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580063.410479:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9a00/0xc86deac208337b31 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580063.410496:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8fae4c7d9200) 00010000:00010000:0.0:1787580063.410499:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787580063.410502:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9a00/0xc86deac208337b31 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580063.410507:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9a00/0xc86deac208337b31 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580063.410547:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208337b23 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d138 expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580063.410562:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8400/0xc86deac208337b38 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d138 expref: 17 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580063.410569:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8fae5bb2f400) 00010000:00010000:0.0:1787580063.410571:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787580063.410573:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae48db8400, rc 0) 00000100:00100000:0.0:1787580063.410614:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae77a89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+17:10420:x1874413239698432:12345-192.168.202.36@tcp:101:stat.0 Request processed in 20197us (20439us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580063.410622:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 53 00000100:00100000:0.0:1787580063.496072:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580063.496185:0:8897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239699072 00000100:00100000:2.0:1787580063.496199:0:8897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239699072 00000100:00100000:2.0:1787580063.496270:0:8897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 54 00000100:00100000:2.0:1787580063.496282:0:8897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae77a8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+17:10426:x1874413239699072:12345-192.168.202.36@tcp:36:truncate.0 00010000:00010000:2.0:1787580063.496350:0:8897:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787580063.496406:0:8897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8400/0xc86deac208337b38 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d138 expref: 17 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580063.496425:0:8897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8fae5bb2f400) 00010000:00010000:2.0:1787580063.496429:0:8897:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787580063.496643:0:8897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9800/0xc86deac208337b3f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580063.496658:0:8897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9800/0xc86deac208337b3f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580063.496668:0:8897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9800/0xc86deac208337b3f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787580063.496747:0:8897:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:2.0:1787580063.496774:0:8897:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d584db40 reply state 00000000114e1280 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9800/0xc86deac208337b3f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580063.496781:0:8897:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787580063.496940:0:8897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae77a8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+19:10426:x1874413239699072:12345-192.168.202.36@tcp:36:truncate.0 Request processed in 660us (883us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1787580063.496946:0:8897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 54 00000020:00080000:2.0:1787580063.496949:0:8897:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787580063.500483:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9800/0xc86deac208337b3f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580063.500503:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9800/0xc86deac208337b3f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580063.500511:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9800/0xc86deac208337b3f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580063.500532:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db9800 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:0.0:1787580063.500537:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9800/0xc86deac208337b3f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580063.500544:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9800/0xc86deac208337b3f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580063.500562:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8fae5bb2f400) 00010000:00010000:0.0:1787580063.500564:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787580063.500570:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9800/0xc86deac208337b3f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580063.500576:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9800/0xc86deac208337b3f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580063.675344:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580063.675429:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239699200 00000100:00100000:1.0:1787580063.675440:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239699200 00000100:00100000:1.0:1787580063.675506:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 55 00000100:00100000:1.0:1787580063.675520:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae77a89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+18:10440:x1874413239699200:12345-192.168.202.36@tcp:101:stat.0 00010000:00010000:1.0:1787580063.675556:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787580063.675581:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58600/0xc86deac208337b46 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d13f expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580063.675662:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58200/0xc86deac208337b4d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580063.675678:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58200/0xc86deac208337b4d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580063.675689:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58200/0xc86deac208337b4d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580063.675721:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac208337b54 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580063.675741:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac208337b54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580063.675748:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac208337b54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580063.676113:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661600/0xc86deac208337b5b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580063.676122:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661600/0xc86deac208337b5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580063.676130:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661600/0xc86deac208337b5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787580063.676168:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:1.0:1787580063.676172:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787580063.676194:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661600/0xc86deac208337b5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580063.676205:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661600/0xc86deac208337b5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580063.676213:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58200/0xc86deac208337b4d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580063.676219:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58200/0xc86deac208337b4d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580063.676234:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58200/0xc86deac208337b4d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580063.676240:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae4ca58200 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:1.0:1787580063.676244:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58200/0xc86deac208337b4d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580063.676251:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58200/0xc86deac208337b4d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580063.676263:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8fae5bb2f900) 00010000:00010000:1.0:1787580063.676266:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787580063.676271:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58200/0xc86deac208337b4d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580063.676276:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58200/0xc86deac208337b4d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580063.676289:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac208337b54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580063.676295:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac208337b54 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580063.676300:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac208337b54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580063.676305:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae4ca59200 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:1.0:1787580063.676307:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac208337b54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580063.676322:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac208337b54 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580063.676330:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8fae5bb2f200) 00010000:00010000:1.0:1787580063.676333:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787580063.676336:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac208337b54 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580063.676342:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac208337b54 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580063.676375:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58600/0xc86deac208337b46 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d13f expref: 20 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580063.676446:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661600/0xc86deac208337b5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d13f expref: 19 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580063.676453:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8fae5bb2f400) 00010000:00010000:1.0:1787580063.676455:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787580063.676457:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae41661600, rc 0) 00000100:00100000:1.0:1787580063.676533:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae77a89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+19:10440:x1874413239699200:12345-192.168.202.36@tcp:101:stat.0 Request processed in 1015us (1214us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580063.676541:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 55 00000100:00100000:2.0:1787580063.795500:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580063.795630:0:8897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239699456 00000100:00100000:0.0:1787580063.795643:0:8897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239699456 00000100:00100000:0.0:1787580063.795708:0:8897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 56 00000100:00100000:0.0:1787580063.795720:0:8897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5f6ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+19:10450:x1874413239699456:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:0.0:1787580063.795742:0:8897:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787580063.795763:0:8897:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea400/0xc86deac208337b62 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d146 expref: -99 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787580063.796079:0:8897:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:0.0:1787580063.796269:0:8897:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea400/0xc86deac208337b62 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d146 expref: 21 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580063.796284:0:8897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fae5bb2ff00) 00010000:00010000:0.0:1787580063.796294:0:8897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787580063.796300:0:8897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea400/0xc86deac208337b62 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d146 expref: 21 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580063.796315:0:8897:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae50fea400, rc 0) 00000100:00100000:0.0:1787580063.796474:0:8897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5f6ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+20:10450:x1874413239699456:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 754us (981us total) trans 4294967339 rc 301/301 00000100:00100000:0.0:1787580063.796486:0:8897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 56 00000100:00100000:0.0:1787580063.812600:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580063.820280:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239699712 00000100:00100000:2.0:1787580063.820298:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239699712 00000100:00100000:2.0:1787580063.820406:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 14 00000100:00100000:2.0:1787580063.820419:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae77a8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+20:10450:x1874413239699712:12345-192.168.202.36@tcp:35:lfs.0 00000100:00100000:2.0:1787580063.821204:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae77a8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+21:10450:x1874413239699712:12345-192.168.202.36@tcp:35:lfs.0 Request processed in 782us (8611us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1787580063.821214:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 14 00000100:00100000:3.0:1787580063.859891:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787580063.859916:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d661180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262799232:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787580063.860015:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787580063.860673:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262799232 00000100:00100000:1.0:1787580063.860685:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262799232 00000100:00100000:1.0:1787580063.860743:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787580063.860754:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74ed2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3316:x1874413262799232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787580063.860793:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787580063.860879:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74ed2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3316:x1874413262799232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (864us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580063.860887:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787580063.861117:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d661180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262799232:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787580063.886332:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580063.886541:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239699968 00000100:00100000:0.0:1787580063.886553:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239699968 00000100:00100000:0.0:1787580063.886619:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 57 00000100:00100000:0.0:1787580063.886630:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74ed1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+21:10456:x1874413239699968:12345-192.168.202.36@tcp:101:bash.0 00010000:00010000:0.0:1787580063.886669:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787580063.886692:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac208337b70 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d14d expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580063.887068:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea400/0xc86deac208337b77 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580063.887085:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661600/0xc86deac208337b5b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d13f expref: 22 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580063.887094:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea400/0xc86deac208337b77 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580063.887128:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661600/0xc86deac208337b5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d13f expref: 22 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580063.887159:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661600/0xc86deac208337b5b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d13f expref: 22 pid: 5854 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580063.887172:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae77a88e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5853:1874413262799360:192.168.202.36@tcp:104: 00000100:00100000:0.0:1787580063.887264:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae45228a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787580063.892827:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae77a88e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5853:1874413262799360:192.168.202.36@tcp:104: 00000100:00100000:3.0:1787580063.893126:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580063.893206:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239700096 00000100:00100000:0.0:1787580063.893214:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239700096 00010000:00010000:0.0:1787580063.893259:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661600/0xc86deac208337b5b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d13f expref: 23 pid: 5854 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580063.893307:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 40 00000100:00100000:0.0:1787580063.893317:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74ed1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+23:2360:x1874413239700096:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787580063.893332:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787580063.893339:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661600/0xc86deac208337b5b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d13f expref: 23 pid: 5854 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580063.893352:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661600/0xc86deac208337b5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d13f expref: 23 pid: 5854 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580063.893415:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661600/0xc86deac208337b5b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d13f expref: 23 pid: 5854 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580063.893434:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8fae5bb2f400) 00010000:00010000:0.0:1787580063.893440:0:5839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea400/0xc86deac208337b77 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580063.893466:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea400/0xc86deac208337b77 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580063.893474:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea400/0xc86deac208337b77 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580063.893490:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787580063.893548:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74ed1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+22:2360:x1874413239700096:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 232us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580063.893556:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 40 00010000:00010000:2.0:1787580063.894620:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea400/0xc86deac208337b77 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580063.894636:0:5853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea400/0xc86deac208337b77 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580063.894642:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea400/0xc86deac208337b77 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787580063.895486:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1787580063.895671:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac208337b70 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d14d expref: 23 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580063.895692:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea400/0xc86deac208337b77 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d14d expref: 22 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580063.895701:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8fae5bb2f400) 00010000:00010000:2.0:1787580063.895703:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787580063.895706:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae50fea400, rc 0) 00000100:00100000:2.0:1787580063.895769:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74ed1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+22:10456:x1874413239699968:12345-192.168.202.36@tcp:101:bash.0 Request processed in 9139us (9449us total) trans 4294967341 rc 0/0 00000100:00100000:2.0:1787580063.895778:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 57 00000100:00100000:3.0:1787580063.902978:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580063.903114:0:8897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239700352 00000100:00100000:0.0:1787580063.903126:0:8897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239700352 00000100:00100000:0.0:1787580063.903209:0:8897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 58 00000100:00100000:0.0:1787580063.903220:0:8897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+22:10456:x1874413239700352:12345-192.168.202.36@tcp:36:bash.0 00010000:00010000:0.0:1787580063.903569:0:8897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea800/0xc86deac208337b85 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580063.903589:0:8897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea800/0xc86deac208337b85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580063.903601:0:8897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea800/0xc86deac208337b85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787580063.904275:0:8897:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:0.0:1787580063.904314:0:8897:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a69afafe reply state 00000000dcd08fd0 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea800/0xc86deac208337b85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580063.904324:0:8897:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787580063.904590:0:8897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+25:10456:x1874413239700352:12345-192.168.202.36@tcp:36:bash.0 Request processed in 1368us (1619us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1787580063.904611:0:8897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 58 00000020:00080000:0.0:1787580063.904617:0:8897:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787580063.906481:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea800/0xc86deac208337b85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580063.906498:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea800/0xc86deac208337b85 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580063.906505:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea800/0xc86deac208337b85 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580063.906510:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae50fea800 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:2.0:1787580063.906515:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea800/0xc86deac208337b85 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580063.906522:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea800/0xc86deac208337b85 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580063.906555:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8fae5bb2f400) 00010000:00010000:2.0:1787580063.906559:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787580063.906564:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea800/0xc86deac208337b85 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580063.906570:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea800/0xc86deac208337b85 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580063.913339:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580063.915574:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239700480 00000100:00100000:1.0:1787580063.915590:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239700480 00000100:00100000:1.0:1787580063.915740:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 59 00000100:00100000:1.0:1787580063.915756:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+24:10456:x1874413239700480:12345-192.168.202.36@tcp:101:bash.0 00010000:00010000:1.0:1787580063.915784:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787580063.915807:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660200/0xc86deac208337b8c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d154 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580063.915910:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661200/0xc86deac208337b93 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580063.915926:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea400/0xc86deac208337b77 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d14d expref: 25 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580063.915935:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661200/0xc86deac208337b93 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580063.915982:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea400/0xc86deac208337b77 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d14d expref: 25 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580063.915997:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea400/0xc86deac208337b77 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d14d expref: 25 pid: 5853 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580063.916010:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d660380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5854:1874413262799488:192.168.202.36@tcp:104: 00000100:00100000:1.0:1787580063.916133:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae77a2fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787580063.920617:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d660380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5854:1874413262799488:192.168.202.36@tcp:104: 00010000:00010000:1.0:1787580063.920656:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661200/0xc86deac208337b93 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580063.921042:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580063.921129:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239700608 00000100:00100000:1.0:1787580063.921137:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239700608 00010000:00010000:1.0:1787580063.921176:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea400/0xc86deac208337b77 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d14d expref: 26 pid: 5853 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580063.922489:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 41 00000100:00100000:1.0:1787580063.922511:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51cac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+26:2361:x1874413239700608:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787580063.922530:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787580063.922650:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea400/0xc86deac208337b77 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d14d expref: 26 pid: 5853 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580063.922670:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea400/0xc86deac208337b77 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d14d expref: 26 pid: 5853 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580063.922694:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea400/0xc86deac208337b77 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d14d expref: 26 pid: 5853 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580063.922712:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8fae5bb2f400) 00010000:00010000:1.0:1787580063.922718:0:5838:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661200/0xc86deac208337b93 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580063.922727:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661200/0xc86deac208337b93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580063.922736:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661200/0xc86deac208337b93 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580063.922776:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787580063.922838:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51cac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+25:2361:x1874413239700608:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 336us (1797us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580063.922847:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 41 00010000:00010000:2.0:1787580063.922997:0:5854:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661200/0xc86deac208337b93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580063.923006:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661200/0xc86deac208337b93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787580063.923068:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787580063.923074:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787580063.923098:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661200/0xc86deac208337b93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580063.923134:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660200/0xc86deac208337b8c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d154 expref: 25 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580063.923151:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661200/0xc86deac208337b93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d154 expref: 24 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580063.923161:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8fae5bb2f400) 00010000:00010000:2.0:1787580063.923164:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787580063.923166:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae41661200, rc 0) 00000100:00100000:2.0:1787580063.923192:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+24:10456:x1874413239700480:12345-192.168.202.36@tcp:101:bash.0 Request processed in 7441us (9862us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580063.923220:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 59 00000100:00100000:0.0:1787580063.926700:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580063.927143:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239700864 00000100:00100000:2.0:1787580063.927155:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239700864 00000100:00100000:2.0:1787580063.927252:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 15 00000100:00100000:2.0:1787580063.927263:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51885450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+24:10456:x1874413239700864:12345-192.168.202.36@tcp:35:bash.0 00000100:00100000:2.0:1787580063.927545:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51885450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+25:10456:x1874413239700864:12345-192.168.202.36@tcp:35:bash.0 Request processed in 283us (857us total) trans 4294967344 rc 0/0 00000100:00100000:2.0:1787580063.927554:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 15 00000100:00100000:3.0:1787580064.028125:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580064.028274:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239701120 00000100:00100000:1.0:1787580064.028285:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239701120 00000100:00100000:1.0:1787580064.028355:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 60 00000100:00100000:1.0:1787580064.028365:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51caf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+25:10466:x1874413239701120:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:1.0:1787580064.028420:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787580064.028446:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660a00/0xc86deac208337b9a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d15b expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787580064.028746:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:1.0:1787580064.028929:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660a00/0xc86deac208337b9a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d15b expref: 27 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580064.028956:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fae5bb2ff00) 00010000:00010000:1.0:1787580064.028960:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787580064.028965:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660a00/0xc86deac208337b9a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d15b expref: 27 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580064.028979:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae41660a00, rc 0) 00000100:00100000:1.0:1787580064.029060:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51caf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+26:10466:x1874413239701120:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 696us (946us total) trans 4294967345 rc 301/301 00000100:00100000:1.0:1787580064.029067:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 60 00000100:00100000:3.0:1787580064.032470:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580064.032582:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239701248 00000100:00100000:2.0:1787580064.032594:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239701248 00000100:00100000:2.0:1787580064.032658:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 61 00000100:00100000:2.0:1787580064.032669:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51cad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+26:10466:x1874413239701248:12345-192.168.202.36@tcp:34:lfs.0 00010000:00010000:2.0:1787580064.032771:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac208337ba8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580064.032788:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac208337ba8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580064.032800:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac208337ba8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580064.032815:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208337baf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580064.032822:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208337baf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580064.032827:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208337baf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580064.033240:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac208337bb6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580064.033252:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac208337bb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580064.033260:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac208337bb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787580064.033305:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac208337bb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580064.033320:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac208337ba8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580064.033328:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac208337ba8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580064.033335:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac208337ba8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580064.033341:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db8200 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:2.0:1787580064.033346:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac208337ba8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580064.033353:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac208337ba8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580064.033365:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8fae5bb2f900) 00010000:00010000:2.0:1787580064.033368:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787580064.033373:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac208337ba8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580064.033425:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac208337ba8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580064.033441:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208337baf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580064.033448:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208337baf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580064.033453:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208337baf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580064.033458:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db9c00 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:2.0:1787580064.033461:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208337baf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580064.033467:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208337baf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580064.033476:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8fae4c7d9f00) 00010000:00010000:2.0:1787580064.033478:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787580064.033481:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208337baf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580064.033486:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208337baf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580064.033502:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac208337bb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580064.033507:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac208337bb6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580064.033518:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac208337bb6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580064.033523:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db9e00 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:2.0:1787580064.033526:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac208337bb6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580064.033531:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac208337bb6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580064.033538:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8fae5bb2f400) 00010000:00010000:2.0:1787580064.033541:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787580064.033543:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac208337bb6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580064.033549:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac208337bb6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580064.033636:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51cad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+26:10466:x1874413239701248:12345-192.168.202.36@tcp:34:lfs.0 Request processed in 966us (1176us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580064.033645:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 61 00000100:00100000:2.0:1787580064.036997:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580064.037091:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239701504 00000100:00100000:1.0:1787580064.037114:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239701504 00000100:00100000:1.0:1787580064.037173:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 16 00000100:00100000:1.0:1787580064.037185:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5f6ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+26:10466:x1874413239701504:12345-192.168.202.36@tcp:35:lfs.0 00000100:00100000:1.0:1787580064.037684:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5f6ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+27:10466:x1874413239701504:12345-192.168.202.36@tcp:35:lfs.0 Request processed in 498us (695us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1787580064.037693:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 16 00000100:00100000:3.0:1787580064.071248:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580064.071415:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239701760 00000100:00100000:1.0:1787580064.071426:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239701760 00000100:00100000:1.0:1787580064.071492:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 62 00000100:00100000:1.0:1787580064.071505:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51cafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+27:10469:x1874413239701760:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:1.0:1787580064.071536:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787580064.071559:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660a00/0xc86deac208337bbd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d162 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580064.071647:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660e00/0xc86deac208337bc4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580064.071663:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660e00/0xc86deac208337bc4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580064.071674:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660e00/0xc86deac208337bc4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580064.071689:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660600/0xc86deac208337bcb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580064.071697:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660600/0xc86deac208337bcb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580064.071704:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660600/0xc86deac208337bcb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580064.072153:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660200/0xc86deac208337bd2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580064.072163:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660200/0xc86deac208337bd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580064.072171:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660200/0xc86deac208337bd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787580064.072180:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1787580064.072284:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660e00/0xc86deac208337bc4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580064.072292:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660e00/0xc86deac208337bc4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580064.072299:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660e00/0xc86deac208337bc4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580064.072305:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae41660e00 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:1.0:1787580064.072310:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660e00/0xc86deac208337bc4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580064.072318:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660e00/0xc86deac208337bc4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580064.072331:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8fae5bb2f900) 00010000:00010000:1.0:1787580064.072334:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787580064.072339:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660e00/0xc86deac208337bc4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580064.072356:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660e00/0xc86deac208337bc4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580064.072372:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660600/0xc86deac208337bcb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580064.072378:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660600/0xc86deac208337bcb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580064.072455:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660600/0xc86deac208337bcb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580064.072461:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae41660600 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:1.0:1787580064.072464:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660600/0xc86deac208337bcb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580064.072470:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660600/0xc86deac208337bcb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580064.072479:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8fae5bb2f200) 00010000:00010000:1.0:1787580064.072481:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787580064.072484:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660600/0xc86deac208337bcb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580064.072489:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660600/0xc86deac208337bcb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580064.072535:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660a00/0xc86deac208337bbd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d162 expref: 30 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580064.072549:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660200/0xc86deac208337bd2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d162 expref: 29 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580064.072564:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8fae5bb2f400) 00010000:00010000:1.0:1787580064.072566:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787580064.072569:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae41660200, rc 0) 00000100:00100000:1.0:1787580064.072645:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51cafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+29:10469:x1874413239701760:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 1142us (1408us total) trans 4294967347 rc 0/0 00000100:00100000:1.0:1787580064.072654:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 62 00000100:00100000:3.0:1787580064.076167:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580064.076313:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239701888 00000100:00100000:1.0:1787580064.076324:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239701888 00000100:00100000:1.0:1787580064.076417:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 4 00000100:00100000:1.0:1787580064.076429:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51caca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+29:2361:x1874413239701888:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787580064.076446:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787580064.076473:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660200/0xc86deac208337bd2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d162 expref: 29 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580064.076493:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8fae5bb2f400) 00010000:00010000:1.0:1787580064.076499:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787580064.076554:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51caca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+28:2361:x1874413239701888:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 128us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580064.076562:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 4 00000100:00100000:3.0:1787580064.078974:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580064.079124:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239702016 00000100:00100000:2.0:1787580064.079135:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239702016 00000100:00100000:2.0:1787580064.079189:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 63 00000100:00100000:2.0:1787580064.079199:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51caf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+28:10469:x1874413239702016:12345-192.168.202.36@tcp:54:lfs.0 00010000:00010000:2.0:1787580064.079269:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac208337be0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580064.079303:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac208337be0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580064.079314:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac208337be0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580064.079341:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac208337be0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580064.079347:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac208337be0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580064.079353:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac208337be0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580064.079359:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db9e00 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:2.0:1787580064.079362:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac208337be0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580064.079369:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac208337be0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580064.079379:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8fae5bb2f400) 00010000:00010000:2.0:1787580064.079419:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787580064.079423:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac208337be0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580064.079429:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac208337be0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580064.079499:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51caf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+28:10469:x1874413239702016:12345-192.168.202.36@tcp:54:lfs.0 Request processed in 301us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580064.079515:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 63 00000100:00100000:3.0:1787580064.082500:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580064.082693:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239702272 00000100:00100000:1.0:1787580064.082704:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239702272 00000100:00100000:1.0:1787580064.082775:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 17 00000100:00100000:1.0:1787580064.082785:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51caf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+28:10469:x1874413239702272:12345-192.168.202.36@tcp:35:lfs.0 00000100:00100000:1.0:1787580064.083222:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51caf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+29:10469:x1874413239702272:12345-192.168.202.36@tcp:35:lfs.0 Request processed in 437us (732us total) trans 4294967348 rc 0/0 00000100:00100000:1.0:1787580064.083244:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 17 00010000:00010000:3.0:1787580064.243668:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787580064.245243:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580064.245356:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239702528 00000100:00100000:1.0:1787580064.245366:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239702528 00000100:00100000:1.0:1787580064.245456:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 64 00000100:00100000:1.0:1787580064.245469:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51cad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+29:10487:x1874413239702528:12345-192.168.202.36@tcp:101:cat.0 00010000:00010000:1.0:1787580064.245495:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787580064.245515:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660200/0xc86deac208337be7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d169 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580064.245637:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660a00/0xc86deac208337bee lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580064.245651:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660a00/0xc86deac208337bee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580064.245664:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660a00/0xc86deac208337bee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787580064.245676:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1787580064.245806:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660200/0xc86deac208337be7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d169 expref: 32 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580064.245825:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660a00/0xc86deac208337bee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d169 expref: 31 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580064.245834:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8fae5bb2f400) 00010000:00010000:1.0:1787580064.245837:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787580064.245841:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae41660a00, rc 0) 00000100:00100000:1.0:1787580064.245921:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51cad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+31:10487:x1874413239702528:12345-192.168.202.36@tcp:101:cat.0 Request processed in 454us (687us total) trans 4294967349 rc 0/0 00000100:00100000:1.0:1787580064.245928:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 64 00000100:00100000:3.0:1787580064.272290:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580064.272415:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239702656 00000100:00100000:2.0:1787580064.272427:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239702656 00000100:00100000:2.0:1787580064.272488:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 65 00000100:00100000:2.0:1787580064.272499:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51caed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+31:10488:x1874413239702656:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:2.0:1787580064.272523:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787580064.272544:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac208337bfc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d170 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580064.272613:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208337c03 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580064.272628:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208337c03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580064.272639:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208337c03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787580064.272865:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1787580064.272869:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787580064.273136:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208337c03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580064.273170:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac208337bfc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d170 expref: 33 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580064.273191:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208337c03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d170 expref: 32 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580064.273213:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8fae5bb2f900) 00010000:00010000:2.0:1787580064.273216:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787580064.273219:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae48db9c00, rc 0) 00000100:00100000:2.0:1787580064.273290:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51caed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+32:10488:x1874413239702656:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 792us (1013us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580064.273298:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 65 00000100:00100000:3.0:1787580064.279301:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580064.279503:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239703040 00000100:00100000:2.0:1787580064.279514:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239703040 00000100:00100000:2.0:1787580064.279578:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 18 00000100:00100000:2.0:1787580064.279589:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51cae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+32:10488:x1874413239703040:12345-192.168.202.36@tcp:35:lfs.0 00000100:00100000:2.0:1787580064.280012:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51cae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+33:10488:x1874413239703040:12345-192.168.202.36@tcp:35:lfs.0 Request processed in 423us (722us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1787580064.280030:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 18 00000100:00100000:3.0:1787580064.283862:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580064.284059:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239703168 00000100:00100000:0.0:1787580064.284071:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239703168 00000100:00100000:0.0:1787580064.284147:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 5 00000100:00100000:0.0:1787580064.284157:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51cadc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+33:10488:x1874413239703168:12345-192.168.202.36@tcp:103:lfs.0 00010000:00010000:0.0:1787580064.284173:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787580064.284201:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661200/0xc86deac208337b93 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d154 expref: 33 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580064.284226:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660a00/0xc86deac208337bee lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d169 expref: 32 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580064.284241:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58000/0xc86deac208337a97 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d115 expref: 31 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580064.284252:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8fae5bb2f400) 00010000:00010000:0.0:1787580064.284264:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787580064.284329:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51cadc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+30:10488:x1874413239703168:12345-192.168.202.36@tcp:103:lfs.0 Request processed in 172us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580064.284337:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 5 00000100:00100000:3.0:1787580064.288902:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580064.288990:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239703296 00000100:00100000:1.0:1787580064.289000:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239703296 00000100:00100000:1.0:1787580064.289074:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 66 00000100:00100000:1.0:1787580064.289084:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51cadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+30:10488:x1874413239703296:12345-192.168.202.36@tcp:58:lfs.0 00010000:00010000:1.0:1787580064.289185:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660200/0xc86deac208337c0a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580064.289201:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660200/0xc86deac208337c0a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580064.289212:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660200/0xc86deac208337c0a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787580064.289925:0:5852:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787580064.290130:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1787580064.290198:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1787580064.290322:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51cadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+30:10488:x1874413239703296:12345-192.168.202.36@tcp:58:lfs.0 Request processed in 1235us (1425us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580064.290332:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 66 00000100:00100000:3.0:1787580064.315494:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580064.315602:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239703424 00000100:00100000:2.0:1787580064.315613:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239703424 00000100:00100000:2.0:1787580064.315678:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 67 00000100:00100000:2.0:1787580064.315688:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51caea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+30:10490:x1874413239703424:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:2.0:1787580064.315708:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787580064.315730:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac208337c11 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d177 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580064.315807:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac208337c18 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580064.315822:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac208337c18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580064.315864:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac208337c18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580064.315881:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8600/0xc86deac208337c1f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580064.315889:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8600/0xc86deac208337c1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580064.315894:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8600/0xc86deac208337c1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580064.316223:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac208337c26 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580064.316233:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac208337c26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580064.316239:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac208337c26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787580064.316277:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787580064.316280:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787580064.316298:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac208337c26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580064.316312:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac208337c26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580064.316321:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac208337c18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580064.316336:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac208337c18 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580064.316343:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac208337c18 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580064.316348:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db8200 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:2.0:1787580064.316353:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac208337c18 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580064.316359:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac208337c18 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580064.316372:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8fae5bb2f900) 00010000:00010000:2.0:1787580064.316375:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787580064.316380:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac208337c18 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580064.316435:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac208337c18 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580064.316449:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8600/0xc86deac208337c1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580064.316454:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8600/0xc86deac208337c1f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580064.316459:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8600/0xc86deac208337c1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580064.316464:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db8600 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:2.0:1787580064.316473:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8600/0xc86deac208337c1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580064.316478:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8600/0xc86deac208337c1f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580064.316486:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8fae4c7d9f00) 00010000:00010000:2.0:1787580064.316488:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787580064.316491:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8600/0xc86deac208337c1f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580064.316496:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8600/0xc86deac208337c1f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580064.316531:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac208337c11 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d177 expref: 32 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580064.316545:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac208337c26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d177 expref: 31 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580064.316552:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8fae5bb2f200) 00010000:00010000:2.0:1787580064.316554:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787580064.316557:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae48db8800, rc 0) 00000100:00100000:2.0:1787580064.316638:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51caea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+31:10490:x1874413239703424:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 950us (1154us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580064.316646:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 67 00000100:00100000:0.0:1787580064.371816:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae504b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874413262800000:0@lo:400:kworker.0 00000100:00100000:0.0:1787580064.371915:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787580064.372057:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae77a8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874413262799744:0@lo:400:kworker.0 00000100:00100000:1.0:1787580064.372090:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787580064.372144:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae504b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874413262800256:0@lo:400:kworker.0 00000100:00100000:1.0:1787580064.372166:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787580064.372195:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787580064.372201:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae77a8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3315:1874413262799616:0@lo:400:kworker.0 00000100:00100000:1.0:1787580064.372240:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787580064.372260:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae504b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1874413262800128:0@lo:400:kworker.0 00000100:00100000:1.0:1787580064.372283:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787580064.372314:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262799744 00000100:00100000:1.0:1787580064.372322:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262799744 00000100:00100000:1.0:1787580064.372361:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262800128 00000100:00100000:1.0:1787580064.372365:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262800128 00000100:00100000:1.0:1787580064.372419:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787580064.372430:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d660380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874413262799744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787580064.372481:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d660380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874413262799744:12345-0@lo:400:kworker.0 Request processed in 53us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580064.372488:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787580064.372523:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae77a8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874413262799744:0@lo:400:kworker.0 00000100:00100000:1.0:1787580064.372547:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787580064.372554:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d661500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874413262800128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787580064.372588:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d661500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874413262800128:12345-0@lo:400:kworker.0 Request processed in 35us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580064.372594:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787580064.372619:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae504b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1874413262800128:0@lo:400:kworker.0 00000100:00100000:1.0:1787580064.372655:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262800000 00000100:00100000:1.0:1787580064.372659:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262800000 00000100:00100000:1.0:1787580064.372681:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262800256 00000100:00100000:1.0:1787580064.372684:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262800256 00000100:00100000:1.0:1787580064.372702:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787580064.372708:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae504b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3317:x1874413262800000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787580064.372738:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae504b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3317:x1874413262800000:12345-0@lo:400:kworker.0 Request processed in 30us (829us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580064.372750:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787580064.372762:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787580064.372769:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d661880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1874413262800256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787580064.372802:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d661880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1874413262800256:12345-0@lo:400:kworker.0 Request processed in 34us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580064.372807:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787580064.372832:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae504b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874413262800256:0@lo:400:kworker.0 00000100:00100000:2.0:1787580064.372950:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae77a88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874413262799872:0@lo:400:kworker.0 00000100:00100000:2.0:1787580064.372982:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787580064.373053:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262799616 00000100:00100000:2.0:1787580064.373063:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262799616 00000100:00100000:2.0:1787580064.373092:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1787580064.373100:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:3315:x1874413262799616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787580064.373137:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:3315:x1874413262799616:12345-0@lo:400:kworker.0 Request processed in 39us (897us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580064.373142:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1787580064.373175:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae77a8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3315:1874413262799616:0@lo:400:kworker.0 00000100:00100000:2.0:1787580064.373191:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262799872 00000100:00100000:2.0:1787580064.373194:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262799872 00000100:00100000:2.0:1787580064.373218:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787580064.373224:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5f6fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874413262799872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787580064.373254:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5f6fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874413262799872:12345-0@lo:400:kworker.0 Request processed in 30us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580064.373260:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787580064.373281:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae77a88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874413262799872:0@lo:400:kworker.0 00000100:00100000:0.0:1787580064.373510:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae504b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874413262800000:0@lo:400:kworker.0 00000100:00080000:3.0:1787580064.373656:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787580064.373661:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787580064.373664:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1787580064.691657:0:11700:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787580064.691665:0:11700:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787580064.691712:0:11700:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1787580064.691719:0:11700:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787580064.691850:0:11700:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae51cae300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11700:1874413262800384:192.168.202.36@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787580064.691946:0:11700:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae48da30c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787580064.695221:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580064.695371:0:11700:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae51cae300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11700:1874413262800384:192.168.202.36@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787580064.697210:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239703552 00000100:00100000:0.0:1787580064.697231:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239703552 00000100:00100000:0.0:1787580064.697300:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 1 00000100:00100000:0.0:1787580064.697311:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51cac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+31:10501:x1874413239703552:12345-192.168.202.36@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1787580064.697429:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51cac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+31:10501:x1874413239703552:12345-192.168.202.36@tcp:900:lhsmtool_posix.0 Request processed in 119us (2217us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580064.697439:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 1 00000100:00100000:2.0:1787580064.707472:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580064.707664:0:8897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239703680 00000100:00100000:0.0:1787580064.707675:0:8897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239703680 00000100:00100000:0.0:1787580064.707731:0:8897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 68 00000100:00100000:0.0:1787580064.707742:0:8897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5f6fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+31:10501:x1874413239703680:12345-192.168.202.36@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787580064.707779:0:8897:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787580064.707885:0:8897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5f6fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+31:10501:x1874413239703680:12345-192.168.202.36@tcp:53:lhsmtool_posix.0 Request processed in 144us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580064.707893:0:8897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 68 00000100:00100000:0.0:1787580064.715036:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580064.718465:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239703808 00000100:00100000:3.0:1787580064.718489:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239703808 00000100:00100000:3.0:1787580064.718548:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 69 00000100:00100000:3.0:1787580064.718558:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae504b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+31:10501:x1874413239703808:12345-192.168.202.36@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787580064.718638:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150fe00/0xc86deac208337c2d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580064.718654:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150fe00/0xc86deac208337c2d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580064.718666:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150fe00/0xc86deac208337c2d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580064.718681:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150ee00/0xc86deac208337c34 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580064.718688:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150ee00/0xc86deac208337c34 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580064.718694:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150ee00/0xc86deac208337c34 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580064.718718:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae40031000/0xc86deac208337c3b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580064.718726:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae40031000/0xc86deac208337c3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580064.718732:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae40031000/0xc86deac208337c3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787580064.718770:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1787580064.718774:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787580064.718787:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fae40031000/0xc86deac208337c3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580064.718798:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150fe00/0xc86deac208337c2d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580064.718809:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150fe00/0xc86deac208337c2d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580064.718817:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150fe00/0xc86deac208337c2d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580064.718822:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae4150fe00 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:3.0:1787580064.718826:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150fe00/0xc86deac208337c2d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580064.718833:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150fe00/0xc86deac208337c2d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580064.718859:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8fae5bb2f000) 00010000:00010000:3.0:1787580064.718862:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787580064.718867:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150fe00/0xc86deac208337c2d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580064.718873:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150fe00/0xc86deac208337c2d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580064.718887:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150ee00/0xc86deac208337c34 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580064.718893:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150ee00/0xc86deac208337c34 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580064.718899:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150ee00/0xc86deac208337c34 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580064.718904:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae4150ee00 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:3.0:1787580064.718912:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150ee00/0xc86deac208337c34 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580064.718919:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150ee00/0xc86deac208337c34 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580064.718926:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff8fae530b1e00) 00010000:00010000:3.0:1787580064.718928:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787580064.718930:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150ee00/0xc86deac208337c34 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580064.718935:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150ee00/0xc86deac208337c34 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580064.718949:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae40031000/0xc86deac208337c3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580064.718956:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae40031000/0xc86deac208337c3b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580064.718962:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae40031000/0xc86deac208337c3b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580064.718967:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae40031000 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:3.0:1787580064.718970:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae40031000/0xc86deac208337c3b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580064.718976:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae40031000/0xc86deac208337c3b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580064.718982:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8fae5bb2f200) 00010000:00010000:3.0:1787580064.718984:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787580064.718991:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae40031000/0xc86deac208337c3b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580064.718997:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae40031000/0xc86deac208337c3b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580064.719083:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae504b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+31:10501:x1874413239703808:12345-192.168.202.36@tcp:34:lhsmtool_posix.0 Request processed in 525us (4067us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580064.719091:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 69 00000100:00100000:3.0:1787580064.723852:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580064.723892:0:8897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239704064 00000100:00100000:3.0:1787580064.723902:0:8897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239704064 00000100:00100000:3.0:1787580064.723958:0:8897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 70 00000100:00100000:3.0:1787580064.723968:0:8897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51cace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+31:10501:x1874413239704064:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787580064.723989:0:8897:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787580064.724011:0:8897:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae40031a00/0xc86deac208337c42 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d17e expref: -99 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580064.724126:0:8897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae40030400/0xc86deac208337c49 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580064.724141:0:8897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae40030400/0xc86deac208337c49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580064.724164:0:8897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae40030400/0xc86deac208337c49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787580064.724176:0:8897:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1787580064.724274:0:8897:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae40030400/0xc86deac208337c49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580064.724293:0:8897:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae40030400/0xc86deac208337c49 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580064.724300:0:8897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae40030400/0xc86deac208337c49 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580064.724305:0:8897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae40030400 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:3.0:1787580064.724309:0:8897:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae40030400/0xc86deac208337c49 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580064.724317:0:8897:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae40030400/0xc86deac208337c49 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580064.724332:0:8897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8fae5bb2f200) 00010000:00010000:3.0:1787580064.724335:0:8897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787580064.724339:0:8897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae40030400/0xc86deac208337c49 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580064.724345:0:8897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae40030400/0xc86deac208337c49 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580064.724407:0:8897:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae40031a00/0xc86deac208337c42 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d17e expref: 33 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580064.724417:0:8897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8fae5bb2f000) 00010000:00010000:3.0:1787580064.724418:0:8897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787580064.724422:0:8897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae40031a00/0xc86deac208337c42 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d17e expref: 33 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580064.724431:0:8897:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae40031a00, rc 0) 00000100:00100000:3.0:1787580064.724504:0:8897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51cace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+32:10501:x1874413239704064:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 Request processed in 537us (663us total) trans 4294967351 rc 301/301 00000100:00100000:3.0:1787580064.724512:0:8897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 70 00000100:00100000:0.0:1787580064.728366:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580064.728593:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239704192 00000100:00100000:3.0:1787580064.728604:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239704192 00000100:00100000:3.0:1787580064.728669:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 71 00000100:00100000:3.0:1787580064.728680:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae504b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+32:10501:x1874413239704192:12345-192.168.202.36@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787580064.728718:0:5853:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787580064.728871:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae504b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+32:10501:x1874413239704192:12345-192.168.202.36@tcp:53:lhsmtool_posix.0 Request processed in 192us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580064.728878:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 71 00000100:00100000:3.0:1787580064.756561:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580064.769846:0:8897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239704448 00000100:00100000:1.0:1787580064.769862:0:8897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239704448 00000100:00100000:1.0:1787580064.773520:0:8897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 72 00000100:00100000:1.0:1787580064.773544:0:8897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51cac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+32:10501:x1874413239704448:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787580064.773568:0:8897:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787580064.773571:0:8897:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787580064.773598:0:8897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208337c03 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d170 expref: 32 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580064.773616:0:8897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8fae5bb2f900) 00010000:00010000:1.0:1787580064.773621:0:8897:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787580064.773636:0:8897:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661600/0xc86deac208337c57 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d185 expref: -99 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787580064.774365:0:8897:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:1.0:1787580064.774644:0:8897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660e00/0xc86deac208337c5e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580064.774669:0:8897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660e00/0xc86deac208337c5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580064.774680:0:8897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660e00/0xc86deac208337c5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580064.774741:0:8897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661600/0xc86deac208337c57 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d185 expref: 34 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580064.774757:0:8897:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660e00/0xc86deac208337c5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d185 expref: 33 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580064.774765:0:8897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8fae5bb2f300) 00010000:00010000:1.0:1787580064.774767:0:8897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787580064.774770:0:8897:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae41660e00, rc 0) 00000100:00100000:1.0:1787580064.774845:0:8897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51cac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+33:10501:x1874413239704448:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 Request processed in 1311us (18293us total) trans 4294967352 rc 0/0 00000100:00100000:1.0:1787580064.774854:0:8897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 72 00000100:00100000:3.0:1787580064.787812:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580064.788056:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239704704 00000100:00100000:0.0:1787580064.788067:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239704704 00000100:00100000:0.0:1787580064.788131:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 73 00000100:00100000:0.0:1787580064.788143:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51cad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+33:10501:x1874413239704704:12345-192.168.202.36@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787580064.788224:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787580064.788254:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660e00/0xc86deac208337c5e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d185 expref: 33 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580064.788272:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8fae5bb2f300) 00010000:00010000:0.0:1787580064.788283:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787580064.788319:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feae00/0xc86deac208337c6c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580064.788334:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feae00/0xc86deac208337c6c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580064.788344:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feae00/0xc86deac208337c6c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580064.788359:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50febe00/0xc86deac208337c73 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x5efd60f6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580064.788366:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50febe00/0xc86deac208337c73 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x5efd60f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580064.788372:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50febe00/0xc86deac208337c73 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x5efd60f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580064.788749:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feae00/0xc86deac208337c6c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580064.788757:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feae00/0xc86deac208337c6c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580064.788764:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feae00/0xc86deac208337c6c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580064.788771:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae50feae00 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:0.0:1787580064.788775:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feae00/0xc86deac208337c6c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580064.788783:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feae00/0xc86deac208337c6c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580064.788805:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8fae5bb2f900) 00010000:00010000:0.0:1787580064.788807:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787580064.788810:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feae00/0xc86deac208337c6c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580064.788815:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feae00/0xc86deac208337c6c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580064.788825:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50febe00/0xc86deac208337c73 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x5efd60f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580064.788830:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50febe00/0xc86deac208337c73 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x5efd60f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580064.788835:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50febe00/0xc86deac208337c73 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x5efd60f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580064.788840:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae50febe00 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:0.0:1787580064.788842:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50febe00/0xc86deac208337c73 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x5efd60f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580064.788848:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50febe00/0xc86deac208337c73 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x5efd60f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580064.788855:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x5efd60f6 (ffff8fae56e35400) 00010000:00010000:0.0:1787580064.788857:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787580064.788860:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50febe00/0xc86deac208337c73 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x5efd60f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580064.788865:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50febe00/0xc86deac208337c73 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x5efd60f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580064.788962:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51cad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+32:10501:x1874413239704704:12345-192.168.202.36@tcp:36:lhsmtool_posix.0 Request processed in 820us (1161us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787580064.788970:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 73 00000100:00100000:3.0:1787580064.791929:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580064.792058:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239704832 00000100:00100000:0.0:1787580064.792068:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239704832 00000100:00100000:0.0:1787580064.792127:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 74 00000100:00100000:0.0:1787580064.792138:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51cae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+32:10501:x1874413239704832:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787580064.792547:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787580064.792576:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb200/0xc86deac208337c7a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d18c expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580064.792612:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb800/0xc86deac208337c81 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580064.792625:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb800/0xc86deac208337c81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580064.792636:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb800/0xc86deac208337c81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580064.792728:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb200/0xc86deac208337c7a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d18c expref: 34 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580064.792745:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb800/0xc86deac208337c81 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d18c expref: 33 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580064.792753:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8fae56e35000) 00010000:00010000:0.0:1787580064.792763:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787580064.792766:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae50feb800, rc 0) 00000100:00100000:0.0:1787580064.792831:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51cae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+33:10501:x1874413239704832:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 Request processed in 695us (913us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580064.792839:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 74 00000100:00100000:3.0:1787580064.795832:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580064.795993:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239705088 00000100:00100000:1.0:1787580064.796003:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239705088 00000100:00100000:1.0:1787580064.796070:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 75 00000100:00100000:1.0:1787580064.796080:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7efc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+33:10501:x1874413239705088:12345-192.168.202.36@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787580064.796158:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661600/0xc86deac208337c88 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580064.796176:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661600/0xc86deac208337c88 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580064.796199:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661600/0xc86deac208337c88 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787580064.796568:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:1.0:1787580064.796580:0:5854:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 412552195814ns, next at 413552193440ns, rc = 0 00000004:00010000:1.0:1787580064.796668:0:5854:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e7674428 reply state 0000000009950bbd transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661600/0xc86deac208337c88 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580064.796678:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787580064.796777:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7efc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+35:10501:x1874413239705088:12345-192.168.202.36@tcp:36:lhsmtool_posix.0 Request processed in 697us (954us total) trans 4294967353 rc 0/0 00000100:00100000:1.0:1787580064.796784:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 75 00010000:00010000:0.0:1787580064.799934:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661600/0xc86deac208337c88 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580064.799948:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661600/0xc86deac208337c88 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580064.799955:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661600/0xc86deac208337c88 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580064.799961:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae41661600 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:0.0:1787580064.799966:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661600/0xc86deac208337c88 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580064.799974:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661600/0xc86deac208337c88 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580064.799991:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8fae56e35000) 00010000:00010000:0.0:1787580064.799994:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787580064.799999:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661600/0xc86deac208337c88 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580064.800005:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661600/0xc86deac208337c88 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580064.804641:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580064.804747:0:8897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239705216 00000100:00100000:1.0:1787580064.804758:0:8897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239705216 00000100:00100000:1.0:1787580064.804807:0:8897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 76 00000100:00100000:1.0:1787580064.804817:0:8897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae504b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+34:10501:x1874413239705216:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787580064.804839:0:8897:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787580064.804857:0:8897:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660600/0xc86deac208337c8f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d193 expref: -99 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580064.804913:0:8897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660600/0xc86deac208337c8f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d193 expref: 35 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580064.804927:0:8897:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660600/0xc86deac208337c8f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d193 expref: 35 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580064.804947:0:8897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8fae56e35000) 00010000:00010000:1.0:1787580064.804963:0:8897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787580064.804967:0:8897:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae41660600, rc 0) 00000100:00100000:1.0:1787580064.806342:0:8897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae504b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+35:10501:x1874413239705216:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 Request processed in 1521us (1705us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580064.806351:0:8897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 76 00000100:00100000:0.0:1787580064.817073:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580064.817207:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239705344 00000100:00100000:1.0:1787580064.817217:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239705344 00000100:00100000:1.0:1787580064.817303:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 25 00000100:00100000:1.0:1787580064.817313:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae504b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2357:x1874413239705344:12345-192.168.202.36@tcp:8:lhsmtool_posix.0 00010000:00080000:1.0:1787580064.817352:0:6708:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 31d1df27-21ab-4c76-bd19-e53fa778bd7e@192.168.202.36@tcp t0 exp 0000000000000000 cur 412 last 0 00000020:00000080:1.0:1787580064.817421:0:6708:0:(genops.c:1385:class_connect()) connect: client 31d1df27-21ab-4c76-bd19-e53fa778bd7e, cookie 0xc86deac208337c96 00002000:00100000:1.0:1787580064.817435:0:6708:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 31d1df27-21ab-4c76-bd19-e53fa778bd7e/ffff8fad41109800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787580064.817459:0:6708:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787580064.817714:0:6708:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787580064.817745:0:6708:0:(import.c:65:import_set_state_nolock()) ffff8fad4110e000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787580064.817814:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae504b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:2357:x1874413239705344:12345-192.168.202.36@tcp:8:lhsmtool_posix.0 Request processed in 500us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580064.817822:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 25 00000100:00100000:0.0:1787580064.821535:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580064.821600:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239705472 00000100:00100000:2.0:1787580064.821610:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239705472 00000100:00100000:2.0:1787580064.821685:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 26 00000100:00100000:2.0:1787580064.821696:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae504b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:0:x1874413239705472:12345-192.168.202.36@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1787580064.822067:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787580064.884503:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7efcaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262800512:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787580064.884569:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580064.884646:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262800512 00000100:00100000:3.0:1787580064.884653:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262800512 00000100:00100000:3.0:1787580064.884699:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787580064.884707:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7efca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262800512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787580064.884731:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787580064.884774:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7efca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262800512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580064.884781:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787580064.884826:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7efcaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262800512:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787580064.932327:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae504b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+7:0:x1874413239705472:12345-192.168.202.36@tcp:2:lhsmtool_posix.0 Request processed in 110624us (110792us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1787580064.932341:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 26 00000001:00100000:0.0:1787580064.933221:0:7653:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 31d1df27-21ab-4c76-bd19-e53fa778bd7e 00000001:00080000:0.0:1787580064.933238:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000100:00100000:1.0:1787580064.949890:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580064.950112:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239705728 00000100:00100000:3.0:1787580064.950123:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239705728 00000100:00100000:3.0:1787580064.950182:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 19 00000100:00100000:3.0:1787580064.950193:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d661180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+35:10501:x1874413239705728:12345-192.168.202.36@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787580064.950459:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d661180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+36:10501:x1874413239705728:12345-192.168.202.36@tcp:35:lhsmtool_posix.0 Request processed in 267us (578us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1787580064.950467:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 19 00000100:00100000:0.0:1787580064.957042:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580064.957168:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239705984 00000100:00100000:3.0:1787580064.957179:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239705984 00000100:00100000:3.0:1787580064.957249:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 77 00000100:00100000:3.0:1787580064.957261:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae504b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+36:10501:x1874413239705984:12345-192.168.202.36@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787580064.957375:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae504b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+36:10501:x1874413239705984:12345-192.168.202.36@tcp:57:lhsmtool_posix.0 Request processed in 115us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580064.957405:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 77 00000100:00100000:0.0:1787580064.969657:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580064.969764:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239706112 00000100:00100000:2.0:1787580064.969776:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239706112 00000100:00100000:2.0:1787580064.969850:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 78 00000100:00100000:2.0:1787580064.969862:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae504b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+36:10501:x1874413239706112:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787580064.969884:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787580064.969912:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208337c9d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d19a expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580064.969996:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9a00/0xc86deac208337ca4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580064.970551:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9a00/0xc86deac208337ca4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580064.970566:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9a00/0xc86deac208337ca4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787580064.970606:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787580064.970629:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9a00/0xc86deac208337ca4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580064.970657:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208337c9d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d19a expref: 38 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580064.970678:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9a00/0xc86deac208337ca4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d19a expref: 37 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580064.970686:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8fae56e35000) 00010000:00010000:2.0:1787580064.970688:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787580064.970692:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae48db9a00, rc 0) 00000100:00100000:2.0:1787580064.970957:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae504b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+37:10501:x1874413239706112:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 Request processed in 1096us (1309us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580064.970965:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 78 00000100:00100000:0.0:1787580064.989346:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580064.989434:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239706240 00000100:00100000:2.0:1787580064.989446:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239706240 00000100:00100000:2.0:1787580064.989651:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 27 00000100:00100000:2.0:1787580064.989663:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae504b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+5:2361:x1874413239706240:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787580064.989683:0:6705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787580064.989704:0:6705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b5ee058b/0xc86deac208337cab lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d1a1 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787580064.989733:0:6705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8c4ea0, blocks: 0x1 00010000:00010000:2.0:1787580064.989752:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=412s v=(0 0) 00010000:00010000:2.0:1787580064.989757:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787580064.989767:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b5ee058b/0xc86deac208337cab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1a1 expref: 6 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580064.989786:0:6705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b5ee058b/0xc86deac208337cab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1a1 expref: 6 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580064.989801:0:6705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae48db8a00, rc 0) 00000100:00100000:2.0:1787580064.989873:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae504b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:2361:x1874413239706240:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 Request processed in 212us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580064.989881:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 27 00000100:00100000:0.0:1787580065.000292:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580065.000470:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239706496 00000100:00100000:2.0:1787580065.000490:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239706496 00000100:00100000:2.0:1787580065.000571:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 79 00000100:00100000:2.0:1787580065.000582:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae504b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+37:10501:x1874413239706496:12345-192.168.202.36@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787580065.000688:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae504b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+37:10501:x1874413239706496:12345-192.168.202.36@tcp:57:lhsmtool_posix.0 Request processed in 107us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580065.000696:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 79 00000100:00080000:0.0:1787580065.001490:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787580065.010436:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580065.010539:0:10268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239706624 00000100:00100000:1.0:1787580065.010549:0:10268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239706624 00000100:00100000:1.0:1787580065.010604:0:10268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 28 00000100:00100000:1.0:1787580065.010614:0:10268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae504b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:10501:x1874413239706624:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787580065.010631:0:10268:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787580065.010653:0:10268:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000620d8838/0xc86deac208337cb2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d1a8 expref: -99 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580065.010692:0:10268:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b5ee058b/0xc86deac208337cab lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1a1 expref: 7 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580065.010700:0:10268:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787580065.010704:0:10268:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787580065.010709:0:10268:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000620d8838/0xc86deac208337cb2 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1a8 expref: 7 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580065.010745:0:10268:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b5ee058b/0xc86deac208337cab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1a1 expref: 7 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580065.010758:0:10268:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b5ee058b/0xc86deac208337cab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1a1 expref: 7 pid: 6705 timeout: 512 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580065.010771:0:10268:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae77a88e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10268:1874413262800640:192.168.202.36@tcp:104: 00000100:00100000:1.0:1787580065.010874:0:10268:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae77a2f480 going to sleep for 11 seconds 00000100:00100000:0.0:1787580065.015263:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580065.015339:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239706752 00000100:00100000:3.0:1787580065.015349:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239706752 00010000:00010000:3.0:1787580065.015423:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b5ee058b/0xc86deac208337cab lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1a1 expref: 8 pid: 6705 timeout: 512 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580065.015455:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 42 00000100:00100000:3.0:1787580065.015466:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae52137450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+8:2361:x1874413239706752:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787580065.015482:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787580065.015514:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b5ee058b/0xc86deac208337cab lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1a1 expref: 8 pid: 6705 timeout: 512 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580065.015529:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b5ee058b/0xc86deac208337cab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1a1 expref: 8 pid: 6705 timeout: 512 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580065.015555:0:5838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787580065.015560:0:5838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787580065.015569:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000620d8838/0xc86deac208337cb2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1a8 expref: 8 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580065.015579:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000620d8838/0xc86deac208337cb2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1a8 expref: 8 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580065.015625:0:5838:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000620d8838/0xc86deac208337cb2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1a8 expref: 8 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580065.015640:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7efcaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5838:1874413262800768:192.168.202.36@tcp:105: 00000100:00100000:3.0:1787580065.015721:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae5f6f6900 going to sleep for 11 seconds 00010000:00010000:1.0:1787580065.016034:0:10268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b5ee058b/0xc86deac208337cab lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1a1 expref: 8 pid: 6705 timeout: 512 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580065.016049:0:10268:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae77a88e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10268:1874413262800640:192.168.202.36@tcp:104: 00010000:00010000:1.0:1787580065.016072:0:10268:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000620d8838/0xc86deac208337cb2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1a8 expref: 7 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580065.016083:0:10268:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae41660e00, rc 0) 00000100:00100000:1.0:1787580065.016120:0:10268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae504b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+7:10501:x1874413239706624:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 Request processed in 5508us (5693us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580065.016128:0:10268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 28 00000100:00100000:1.0:1787580065.023538:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7efcaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5838:1874413262800768:192.168.202.36@tcp:105: 00010000:00010000:1.0:1787580065.023565:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787580065.023620:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae52137450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:2361:x1874413239706752:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 8155us (8366us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580065.023631:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 42 00000100:00100000:3.0:1787580065.032854:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580065.034121:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239706880 00000100:00100000:2.0:1787580065.034133:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239706880 00002000:00100000:2.0:1787580065.034181:0:6713:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8fae7efc8700 x1874413239706880/t0(0) o4->31d1df27-21ab-4c76-bd19-e53fa778bd7e@192.168.202.36@tcp:551/0 lens 504/0 e 0 to 0 dl 1787580076 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787580065.034259:0:6713:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8fae7efc8700 with x1874413239706880 ext(0->8) 00002000:00010000:2.0:1787580065.034267:0:6713:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8fae7efc8700 00000100:00100000:2.0:1787580065.034344:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 0 00000100:00100000:2.0:1787580065.034354:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7efc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:2361:x1874413239706880:12345-192.168.202.36@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787580065.035373:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7efc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+8:2361:x1874413239706880:12345-192.168.202.36@tcp:4:lhsmtool_posix.0 Request processed in 1017us (2540us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1787580065.035424:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 0 00002000:00100000:2.0:1787580065.035434:0:6713:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8fae7efc8700 x1874413239706880/t4294967302(0) o4->31d1df27-21ab-4c76-bd19-e53fa778bd7e@192.168.202.36@tcp:551/0 lens 504/448 e 0 to 0 dl 1787580076 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787580065.035443:0:6713:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8fae7efc8700 with x1874413239706880 ext(0->8) 00002000:00010000:2.0:1787580065.035448:0:6713:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8fae7efc8700 00000100:00100000:1.0:1787580065.039732:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580065.039771:0:8897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239707008 00000100:00100000:3.0:1787580065.039781:0:8897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239707008 00000100:00100000:3.0:1787580065.040003:0:8897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 80 00000100:00100000:3.0:1787580065.042097:0:8897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae77a89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+37:10501:x1874413239707008:12345-192.168.202.36@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1787580065.155760:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967343 is committed 00000001:00080000:1.0:1787580065.155781:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967353 is committed 00000004:00080000:1.0:1787580065.155784:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:1.0:1787580065.155828:0:5874:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000001:00080000:1.0:1787580065.155837:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000020:00080000:1.0:1787580065.155850:0:5885:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:1.0:1787580065.155862:0:5885:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1787580065.155881:0:8897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae77a89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+13:10501:x1874413239707008:12345-192.168.202.36@tcp:44:lhsmtool_posix.0 Request processed in 113874us (116150us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580065.155891:0:8897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 80 00000100:00100000:0.0:1787580065.156957:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787580065.156975:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae504b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262800896:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787580065.157043:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580065.157097:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262800896 00000100:00100000:0.0:1787580065.157105:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262800896 00000100:00100000:0.0:1787580065.157146:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787580065.157156:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae504b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262800896:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1787580065.157318:0:6705:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1787580065.157322:0:6705:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787580064 00002000:00010000:0.0:1787580065.157324:0:6705:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787580065.157326:0:6705:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1787580064 -> 1787580064 00002000:00010000:0.0:1787580065.157329:0:6705:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1787580065.157365:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae504b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3316:x1874413262800896:12345-0@lo:2:osp-syn-1-0.0 Request processed in 210us (321us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1787580065.157407:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:0.0:1787580065.157450:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8fae504b1f80/2, rc 0, transno 4294967303 00000100:00100000:0.0:1787580065.157457:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae504b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262800896:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787580065.160566:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580065.160644:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239707136 00000100:00100000:0.0:1787580065.160654:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239707136 00000100:00100000:0.0:1787580065.160704:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 30 00000100:00100000:0.0:1787580065.160715:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7efc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+8:2360:x1874413239707136:12345-192.168.202.36@tcp:16:lhsmtool_posix.0 00000040:00080000:0.0:1787580065.178606:0:12030:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787580065.178617:0:12030:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787580065.178659:0:12030:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1787580065.178665:0:12030:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787580065.222801:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580065.222866:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580065.222901:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580065.222946:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239707264 00000100:00100000:1.0:1787580065.222956:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239707264 00000100:00100000:1.0:1787580065.223023:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 293 00000100:00100000:1.0:1787580065.223035:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ff68ada-0c43-4367-93b7-ad31684360cf+13:2359:x1874413239707264:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:3.0:1787580065.223068:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239707392 00000100:00100000:3.0:1787580065.223085:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239707392 00000100:00100000:1.0:1787580065.223107:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ff68ada-0c43-4367-93b7-ad31684360cf+13:2359:x1874413239707264:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 75us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580065.223115:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 293 00000100:00100000:3.0:1787580065.223124:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 67 00000100:00100000:3.0:1787580065.223131:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae77a8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+7:2359:x1874413239707392:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:1.0:1787580065.223146:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239707520 00000100:00100000:1.0:1787580065.223157:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239707520 00000100:00100000:3.0:1787580065.223176:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae77a8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+7:2359:x1874413239707392:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 46us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580065.223182:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 67 00000100:00080000:3.0:1787580065.223199:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787580065.223202:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 145 00000100:00080000:3.0:1787580065.223204:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787580065.223209:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae77a88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d66e8ae-0b45-4a46-9f01-8e93d52be8ea+5:2359:x1874413239707520:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:1.0:1787580065.223238:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae77a88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d66e8ae-0b45-4a46-9f01-8e93d52be8ea+5:2359:x1874413239707520:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 31us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580065.223245:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 145 00010000:00010000:1.0:1787580065.269255:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787580065.270787:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:0.0:1787580065.270813:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:0.0:1787580065.270943:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7efc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:2360:x1874413239707136:12345-192.168.202.36@tcp:16:lhsmtool_posix.0 Request processed in 110224us (110377us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580065.270956:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 30 00000100:00100000:3.0:1787580065.274343:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580065.278826:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239707776 00000100:00100000:0.0:1787580065.278848:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239707776 00000100:00100000:0.0:1787580065.278910:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 81 00000100:00100000:0.0:1787580065.278921:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7efc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+13:10501:x1874413239707776:12345-192.168.202.36@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787580065.278978:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787580065.279020:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9a00/0xc86deac208337ca4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d19a expref: 13 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580065.279044:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8fae56e35000) 00010000:00010000:0.0:1787580065.279059:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787580065.279091:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feac00/0xc86deac208337cb9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580065.279106:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feac00/0xc86deac208337cb9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580065.279116:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feac00/0xc86deac208337cb9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787580065.279380:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001ce606c9 reply state 000000001d1a3e68 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feac00/0xc86deac208337cb9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580065.279416:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787580065.279527:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7efc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+14:10501:x1874413239707776:12345-192.168.202.36@tcp:36:lhsmtool_posix.0 Request processed in 607us (5194us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1787580065.279536:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 81 00000100:00100000:3.0:1787580065.283239:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580065.283280:0:10268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239707904 00000100:00100000:3.0:1787580065.283292:0:10268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239707904 00000100:00100000:3.0:1787580065.283351:0:10268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 31 00000100:00100000:3.0:1787580065.283363:0:10268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7efc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:2361:x1874413239707904:12345-192.168.202.36@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787580065.283701:0:10268:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1787580065.283706:0:10268:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1787580064 -> 1787580063 00002000:00010000:3.0:1787580065.283708:0:10268:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787580062 00002000:00010000:3.0:1787580065.283711:0:10268:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1787580064 -> 1787580063 00002000:00010000:3.0:1787580065.283713:0:10268:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1787580065.283780:0:10268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7efc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+7:2361:x1874413239707904:12345-192.168.202.36@tcp:2:lhsmtool_posix.0 Request processed in 418us (552us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1787580065.283788:0:10268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 31 00010000:00010000:2.0:1787580065.284021:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feac00/0xc86deac208337cb9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580065.284032:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feac00/0xc86deac208337cb9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580065.284040:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feac00/0xc86deac208337cb9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580065.284047:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae50feac00 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:2.0:1787580065.284052:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feac00/0xc86deac208337cb9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580065.284077:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feac00/0xc86deac208337cb9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580065.284094:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8fae56e35000) 00010000:00010000:2.0:1787580065.284097:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787580065.284102:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feac00/0xc86deac208337cb9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580065.284109:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feac00/0xc86deac208337cb9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580065.288713:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580065.289247:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239708160 00000100:00100000:1.0:1787580065.289257:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239708160 00000100:00100000:1.0:1787580065.289357:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 82 00000100:00100000:1.0:1787580065.289368:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5f6fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+13:10501:x1874413239708160:12345-192.168.202.36@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787580065.289479:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660a00/0xc86deac208337cc0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580065.289500:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb800/0xc86deac208337c81 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d18c expref: 13 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580065.289509:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660a00/0xc86deac208337cc0 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580065.289547:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb800/0xc86deac208337c81 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d18c expref: 13 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580065.289563:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb800/0xc86deac208337c81 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d18c expref: 13 pid: 5852 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580065.289578:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae77a8b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5854:1874413262801024:192.168.202.36@tcp:104: 00000100:00100000:1.0:1787580065.289669:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae49ef0cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787580065.296478:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580065.296720:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae77a8b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5854:1874413262801024:192.168.202.36@tcp:104: 00010000:00010000:3.0:1787580065.296747:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660a00/0xc86deac208337cc0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580065.296933:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239708288 00000100:00100000:1.0:1787580065.297068:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239708288 00010000:00010000:1.0:1787580065.297106:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb800/0xc86deac208337c81 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d18c expref: 14 pid: 5852 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580065.297213:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 43 00000100:00100000:1.0:1787580065.297225:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae504b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+14:2360:x1874413239708288:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787580065.297244:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787580065.297251:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb800/0xc86deac208337c81 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d18c expref: 14 pid: 5852 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580065.297263:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb800/0xc86deac208337c81 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d18c expref: 14 pid: 5852 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580065.297285:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb800/0xc86deac208337c81 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d18c expref: 14 pid: 5852 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580065.297300:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8fae56e35000) 00010000:00010000:1.0:1787580065.297304:0:5840:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660a00/0xc86deac208337cc0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580065.297314:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660a00/0xc86deac208337cc0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580065.297322:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660a00/0xc86deac208337cc0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580065.297350:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787580065.297425:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae504b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+13:2360:x1874413239708288:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 201us (955us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580065.297442:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 43 00010000:00010000:3.0:1787580065.297663:0:5854:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660a00/0xc86deac208337cc0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580065.297678:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660a00/0xc86deac208337cc0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580065.297709:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660a00/0xc86deac208337cc0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580065.297717:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660a00/0xc86deac208337cc0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580065.297723:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660a00/0xc86deac208337cc0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580065.297729:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae41660a00 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:3.0:1787580065.297734:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660a00/0xc86deac208337cc0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580065.297742:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660a00/0xc86deac208337cc0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580065.297752:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8fae56e35000) 00010000:00010000:3.0:1787580065.297755:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787580065.297759:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660a00/0xc86deac208337cc0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580065.297766:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660a00/0xc86deac208337cc0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580065.297825:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5f6fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+12:10501:x1874413239708160:12345-192.168.202.36@tcp:55:lhsmtool_posix.0 Request processed in 8459us (9135us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787580065.297833:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 82 00000100:00100000:0.0:1787580065.305291:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580065.305567:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239708416 00000100:00100000:3.0:1787580065.305578:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239708416 00000100:00100000:3.0:1787580065.305641:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 32 00000100:00100000:3.0:1787580065.305653:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae504b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+7:2361:x1874413239708416:12345-192.168.202.36@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787580065.305699:0:6708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a3e03c02/0xc86deac208337cc7 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580065.305721:0:6708:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000620d8838/0xc86deac208337cb2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1a8 expref: 7 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580065.305731:0:6708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787580065.305735:0:6708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787580065.305741:0:6708:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a3e03c02/0xc86deac208337cc7 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580065.305778:0:6708:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000620d8838/0xc86deac208337cb2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1a8 expref: 7 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580065.305793:0:6708:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000620d8838/0xc86deac208337cb2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1a8 expref: 7 pid: 10268 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580065.305808:0:6708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7efc8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6708:1874413262801152:192.168.202.36@tcp:104: 00000100:00100000:3.0:1787580065.305890:0:6708:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae50970f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787580065.312306:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580065.312414:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239708544 00000100:00100000:0.0:1787580065.312426:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239708544 00010000:00010000:0.0:1787580065.312467:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000620d8838/0xc86deac208337cb2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1a8 expref: 8 pid: 10268 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580065.312511:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 44 00000100:00100000:0.0:1787580065.312523:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae77a8a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+8:2360:x1874413239708544:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787580065.312539:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787580065.312562:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000620d8838/0xc86deac208337cb2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1a8 expref: 8 pid: 10268 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580065.312591:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000620d8838/0xc86deac208337cb2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1a8 expref: 8 pid: 10268 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580065.312619:0:5838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787580065.312624:0:5838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787580065.312629:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a3e03c02/0xc86deac208337cc7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580065.312639:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a3e03c02/0xc86deac208337cc7 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580065.312660:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787580065.312715:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae77a8a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+8:2360:x1874413239708544:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 193us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580065.312723:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 44 00010000:00010000:3.0:1787580065.313131:0:6708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000620d8838/0xc86deac208337cb2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1a8 expref: 7 pid: 10268 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580065.313147:0:6708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7efc8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6708:1874413262801152:192.168.202.36@tcp:104: 00010000:00010000:3.0:1787580065.313173:0:6708:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a3e03c02/0xc86deac208337cc7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580065.313183:0:6708:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a3e03c02/0xc86deac208337cc7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580065.313190:0:6708:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a3e03c02/0xc86deac208337cc7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580065.313215:0:6708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a3e03c02/0xc86deac208337cc7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580065.313224:0:6708:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a3e03c02/0xc86deac208337cc7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580065.313232:0:6708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a3e03c02/0xc86deac208337cc7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580065.313239:0:6708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae5f6d6400 already unused, calling callback (ffffffffc155a230) 00010000:00010000:3.0:1787580065.313243:0:6708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3e03c02/0xc86deac208337cc7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580065.313251:0:6708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3e03c02/0xc86deac208337cc7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580065.313263:0:6708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a3e03c02/0xc86deac208337cc7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580065.313278:0:6708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a3e03c02/0xc86deac208337cc7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580065.313344:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae504b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:2361:x1874413239708416:12345-192.168.202.36@tcp:1:lhsmtool_posix.0 Request processed in 7693us (8063us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580065.313352:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 32 00000100:00100000:1.0:1787580065.318491:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580065.318632:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239708800 00000100:00100000:3.0:1787580065.318642:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239708800 00000100:00100000:3.0:1787580065.318724:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 83 00000100:00100000:3.0:1787580065.318735:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae77a8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+12:10501:x1874413239708800:12345-192.168.202.36@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787580065.318816:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6400/0xc86deac208337cce lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580065.318849:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6400/0xc86deac208337cce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580065.318861:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6400/0xc86deac208337cce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580065.319248:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7a00/0xc86deac208337cd5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580065.319263:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660600/0xc86deac208337c8f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d193 expref: 13 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580065.319271:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7a00/0xc86deac208337cd5 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580065.319322:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660600/0xc86deac208337c8f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d193 expref: 13 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580065.319338:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660600/0xc86deac208337c8f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d193 expref: 13 pid: 8897 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580065.319354:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7efc8380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5852:1874413262801280:192.168.202.36@tcp:104: 00000100:00100000:3.0:1787580065.319706:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae50970f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787580065.329080:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7efc8380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5852:1874413262801280:192.168.202.36@tcp:104: 00010000:00010000:0.0:1787580065.329110:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7a00/0xc86deac208337cd5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580065.329236:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580065.329524:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239708928 00000100:00100000:1.0:1787580065.329532:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239708928 00010000:00010000:1.0:1787580065.329570:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660600/0xc86deac208337c8f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d193 expref: 14 pid: 8897 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580065.329753:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 45 00000100:00100000:1.0:1787580065.329804:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5f6fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+14:2361:x1874413239708928:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787580065.329854:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787580065.329879:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660600/0xc86deac208337c8f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d193 expref: 14 pid: 8897 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580065.329916:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660600/0xc86deac208337c8f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d193 expref: 14 pid: 8897 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580065.329972:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660600/0xc86deac208337c8f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d193 expref: 14 pid: 8897 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580065.330036:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8fae56e35000) 00010000:00010000:1.0:1787580065.330042:0:5840:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7a00/0xc86deac208337cd5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580065.330052:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7a00/0xc86deac208337cd5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580065.330060:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7a00/0xc86deac208337cd5 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580065.330180:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787580065.330286:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5f6fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+13:2361:x1874413239708928:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 521us (1050us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580065.330322:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 45 00010000:00010000:2.0:1787580065.331066:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7a00/0xc86deac208337cd5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580065.331078:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7a00/0xc86deac208337cd5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787580065.331281:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:2.0:1787580065.331457:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:2.0:1787580065.331529:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:2.0:1787580065.331634:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5f6fdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5852:1874413262801408:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787580065.331695:0:5852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787580065.331735:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae4cf6c480 going to sleep for 11 seconds 00000100:00100000:0.0:1787580065.331815:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262801408 00000100:00100000:0.0:1787580065.331824:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262801408 00000100:00100000:0.0:1787580065.331882:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787580065.331892:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5f6fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5852:x1874413262801408:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787580065.331980:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5f6fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5852:x1874413262801408:12345-0@lo:1000:mdt00_000.0 Request processed in 89us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580065.331997:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787580065.332546:0:5852:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:2.0:1787580065.332554:0:5852:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8fae504b1f80, transno 4294967303 00000100:00100000:2.0:1787580065.332574:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5f6fdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5852:1874413262801408:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1787580065.335173:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:2.0:1787580065.335270:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5f6fdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5852:1874413262801536:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787580065.335341:0:5852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787580065.335402:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae455b29c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787580065.338051:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262801536 00000100:00100000:3.0:1787580065.338066:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262801536 00000100:00100000:3.0:1787580065.338131:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787580065.338143:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5f6fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5852:x1874413262801536:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787580065.338435:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5f6fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5852:x1874413262801536:12345-0@lo:1000:mdt00_000.0 Request processed in 293us (3092us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1787580065.338444:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787580065.339236:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5f6fdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5852:1874413262801536:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1787580065.339287:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7a00/0xc86deac208337cd5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580065.339298:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7a00/0xc86deac208337cd5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580065.339306:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7a00/0xc86deac208337cd5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580065.339311:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae5f6d7a00 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:2.0:1787580065.339316:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7a00/0xc86deac208337cd5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580065.339324:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7a00/0xc86deac208337cd5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580065.339342:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8fae56e35000) 00010000:00010000:2.0:1787580065.339345:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787580065.339350:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7a00/0xc86deac208337cd5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580065.339357:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7a00/0xc86deac208337cd5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580065.339419:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660200/0xc86deac208337c0a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580065.339426:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660200/0xc86deac208337c0a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580065.339439:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660200/0xc86deac208337c0a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580065.339443:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae41660200 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:2.0:1787580065.339447:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660200/0xc86deac208337c0a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580065.339452:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660200/0xc86deac208337c0a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580065.339461:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8fae5bb2f200) 00010000:00010000:2.0:1787580065.339464:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787580065.339467:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660200/0xc86deac208337c0a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580065.339472:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660200/0xc86deac208337c0a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580065.339495:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208337cdc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580065.339510:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac208337c26 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d177 expref: 16 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580065.339519:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208337cdc lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580065.339554:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac208337c26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d177 expref: 16 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580065.339582:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac208337c26 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d177 expref: 16 pid: 5853 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580065.339597:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5f6fc700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5852:1874413262801664:192.168.202.36@tcp:104: 00000100:00100000:2.0:1787580065.339679:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae45236c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787580065.347673:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5f6fc700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5852:1874413262801664:192.168.202.36@tcp:104: 00010000:00010000:3.0:1787580065.347705:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208337cdc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580065.350338:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580065.350446:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239709056 00000100:00100000:3.0:1787580065.350457:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239709056 00010000:00010000:3.0:1787580065.350501:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac208337c26 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d177 expref: 17 pid: 5853 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580065.350539:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 46 00000100:00100000:3.0:1787580065.350549:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5f6fce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+17:2360:x1874413239709056:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787580065.350578:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787580065.350586:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac208337c26 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d177 expref: 17 pid: 5853 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580065.350599:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac208337c26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d177 expref: 17 pid: 5853 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580065.350621:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac208337c26 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d177 expref: 17 pid: 5853 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580065.350637:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8fae5bb2f200) 00010000:00010000:3.0:1787580065.350642:0:5839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208337cdc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580065.350652:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208337cdc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580065.350659:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208337cdc lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580065.350690:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787580065.350744:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5f6fce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+16:2360:x1874413239709056:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 197us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580065.350753:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 46 00010000:00010000:2.0:1787580065.350877:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208337cdc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580065.350885:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208337cdc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580065.350897:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208337cdc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580065.350902:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208337cdc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580065.350908:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208337cdc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580065.350914:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db9000 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:2.0:1787580065.350918:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208337cdc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580065.350925:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208337cdc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580065.350935:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8fae5bb2f200) 00010000:00010000:2.0:1787580065.350956:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787580065.350960:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208337cdc lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580065.350966:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208337cdc lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580065.350977:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6400/0xc86deac208337cce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580065.350982:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6400/0xc86deac208337cce lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580065.350987:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6400/0xc86deac208337cce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580065.350992:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae5f6d6400 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:2.0:1787580065.350994:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6400/0xc86deac208337cce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580065.351000:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6400/0xc86deac208337cce lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580065.351008:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8fae5bb2f200) 00010000:00010000:2.0:1787580065.351019:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787580065.351023:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6400/0xc86deac208337cce lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580065.351028:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6400/0xc86deac208337cce lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580065.351251:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae77a8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+15:10501:x1874413239708800:12345-192.168.202.36@tcp:57:lhsmtool_posix.0 Request processed in 32517us (32767us total) trans 4294967360 rc 0/0 00000100:00100000:2.0:1787580065.351269:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 83 00000020:00080000:2.0:1787580065.351273:0:5852:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1787580065.352527:0:11700:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787580065.352536:0:11700:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787580065.352568:0:11700:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1787580065.352574:0:11700:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787580065.357007:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580065.357085:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239709312 00000100:00100000:3.0:1787580065.357109:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239709312 00000100:00100000:3.0:1787580065.357167:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 20 00000100:00100000:3.0:1787580065.357179:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74ed1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+15:10501:x1874413239709312:12345-192.168.202.36@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787580065.357895:0:5855:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787580065.358035:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:3.0:1787580065.358088:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7200/0xc86deac208337ce3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580065.358105:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7200/0xc86deac208337ce3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580065.358117:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7200/0xc86deac208337ce3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580065.358126:0:5855:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7200/0xc86deac208337ce3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580065.358133:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7200/0xc86deac208337ce3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580065.358139:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7200/0xc86deac208337ce3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580065.358154:0:5855:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787580065.358247:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74ed1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+17:10501:x1874413239709312:12345-192.168.202.36@tcp:35:lhsmtool_posix.0 Request processed in 1067us (1249us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1787580065.358256:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 20 00000020:00080000:3.0:1787580065.358261:0:5855:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787580065.358490:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787580065.358497:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7200/0xc86deac208337ce3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580065.358504:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae5f6d7200 already unused, calling callback (ffffffffc155a230) 00010000:00010000:0.0:1787580065.358509:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7200/0xc86deac208337ce3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580065.358517:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7200/0xc86deac208337ce3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580065.358529:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8fae530b1100) 00010000:00010000:0.0:1787580065.358532:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787580065.358537:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7200/0xc86deac208337ce3 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580065.358543:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7200/0xc86deac208337ce3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580065.358560:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787580065.358562:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787580065.358563:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787580066.292846:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787580066.355655:0:11700:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787580066.355665:0:11700:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787580066.355698:0:11700:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1787580066.355718:0:11700:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1787580067.273535:0:12081:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787580067.273547:0:12081:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787580067.273600:0:12081:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1787580067.273608:0:12081:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787580067.318893:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787580067.471753:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580067.471900:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239709568 00000100:00100000:3.0:1787580067.471912:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239709568 00000100:00100000:3.0:1787580067.471988:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 84 00000100:00100000:3.0:1787580067.472011:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5f6fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+17:10520:x1874413239709568:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:3.0:1787580067.472039:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787580067.472063:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6800/0xc86deac208337cea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d1af expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580067.472346:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6c00/0xc86deac208337cf1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580067.472362:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6c00/0xc86deac208337cf1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580067.472373:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6c00/0xc86deac208337cf1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787580067.472421:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:3.0:1787580067.472616:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6800/0xc86deac208337cea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1af expref: 20 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580067.472633:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6c00/0xc86deac208337cf1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1af expref: 19 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580067.472643:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8fae5bb2f900) 00010000:00010000:3.0:1787580067.472645:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787580067.472650:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae5f6d6c00, rc 0) 00000100:00100000:3.0:1787580067.472720:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5f6fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+19:10520:x1874413239709568:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 711us (985us total) trans 4294967363 rc 0/0 00000100:00100000:3.0:1787580067.472734:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 84 00000100:00080000:2.0:1787580067.473092:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787580067.479322:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580067.479432:0:8897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239709696 00000100:00100000:1.0:1787580067.479443:0:8897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239709696 00000100:00100000:1.0:1787580067.479497:0:8897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 85 00000100:00100000:1.0:1787580067.479507:0:8897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7efcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+19:10520:x1874413239709696:12345-192.168.202.36@tcp:34:lfs.0 00010000:00010000:1.0:1787580067.479587:0:8897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661200/0xc86deac208337cff lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580067.479605:0:8897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661200/0xc86deac208337cff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580067.479619:0:8897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661200/0xc86deac208337cff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580067.479635:0:8897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661600/0xc86deac208337d06 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580067.479642:0:8897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661600/0xc86deac208337d06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580067.479648:0:8897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661600/0xc86deac208337d06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580067.480306:0:8897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660a00/0xc86deac208337d0d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580067.480321:0:8897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660a00/0xc86deac208337d0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580067.480329:0:8897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660a00/0xc86deac208337d0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787580067.480375:0:8897:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660a00/0xc86deac208337d0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580067.480425:0:8897:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661200/0xc86deac208337cff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580067.480433:0:8897:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661200/0xc86deac208337cff lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580067.480440:0:8897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661200/0xc86deac208337cff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580067.480446:0:8897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae41661200 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:1.0:1787580067.480450:0:8897:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661200/0xc86deac208337cff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580067.480457:0:8897:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661200/0xc86deac208337cff lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580067.480470:0:8897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8fae5bb2f900) 00010000:00010000:1.0:1787580067.480473:0:8897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787580067.480478:0:8897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661200/0xc86deac208337cff lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580067.480484:0:8897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661200/0xc86deac208337cff lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580067.480506:0:8897:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661600/0xc86deac208337d06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580067.480512:0:8897:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661600/0xc86deac208337d06 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580067.480518:0:8897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661600/0xc86deac208337d06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580067.480523:0:8897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae41661600 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:1.0:1787580067.480526:0:8897:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661600/0xc86deac208337d06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580067.480532:0:8897:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661600/0xc86deac208337d06 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580067.480540:0:8897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8fae5bb2f700) 00010000:00010000:1.0:1787580067.480542:0:8897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787580067.480546:0:8897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661600/0xc86deac208337d06 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580067.480552:0:8897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661600/0xc86deac208337d06 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580067.480565:0:8897:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660a00/0xc86deac208337d0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580067.480571:0:8897:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660a00/0xc86deac208337d0d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580067.480577:0:8897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660a00/0xc86deac208337d0d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580067.480588:0:8897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae41660a00 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:1.0:1787580067.480592:0:8897:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660a00/0xc86deac208337d0d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580067.480598:0:8897:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660a00/0xc86deac208337d0d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580067.480606:0:8897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8fae5bb2fd00) 00010000:00010000:1.0:1787580067.480608:0:8897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787580067.480611:0:8897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660a00/0xc86deac208337d0d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580067.480616:0:8897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660a00/0xc86deac208337d0d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580067.480708:0:8897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7efcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+19:10520:x1874413239709696:12345-192.168.202.36@tcp:34:lfs.0 Request processed in 1200us (1397us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580067.480717:0:8897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 85 00000100:00100000:0.0:1787580067.535851:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580067.536781:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239709952 00000100:00100000:3.0:1787580067.536793:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239709952 00000100:00100000:3.0:1787580067.536864:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 86 00000100:00100000:3.0:1787580067.536875:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae504b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+19:10523:x1874413239709952:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:3.0:1787580067.536896:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787580067.536917:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6800/0xc86deac208337d14 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d1b6 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580067.537003:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7e00/0xc86deac208337d1b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580067.537019:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7e00/0xc86deac208337d1b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580067.537031:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7e00/0xc86deac208337d1b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580067.537046:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7600/0xc86deac208337d22 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580067.537053:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7600/0xc86deac208337d22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580067.537060:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7600/0xc86deac208337d22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580067.537438:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7c00/0xc86deac208337d29 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580067.537455:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7c00/0xc86deac208337d29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580067.537463:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7c00/0xc86deac208337d29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787580067.537475:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1787580067.537577:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7e00/0xc86deac208337d1b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580067.537585:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7e00/0xc86deac208337d1b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580067.537592:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7e00/0xc86deac208337d1b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580067.537596:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae5f6d7e00 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:3.0:1787580067.537599:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7e00/0xc86deac208337d1b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580067.537604:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7e00/0xc86deac208337d1b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580067.537612:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8fae5bb2f900) 00010000:00010000:3.0:1787580067.537615:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787580067.537617:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7e00/0xc86deac208337d1b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580067.537622:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7e00/0xc86deac208337d1b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580067.537633:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7600/0xc86deac208337d22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580067.537644:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7600/0xc86deac208337d22 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580067.537650:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7600/0xc86deac208337d22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580067.537655:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae5f6d7600 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:3.0:1787580067.538467:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7600/0xc86deac208337d22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580067.538476:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7600/0xc86deac208337d22 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580067.538488:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8fae530b1e00) 00010000:00010000:3.0:1787580067.538491:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787580067.538494:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7600/0xc86deac208337d22 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580067.538500:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7600/0xc86deac208337d22 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580067.538551:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6800/0xc86deac208337d14 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1b6 expref: 22 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580067.538566:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7c00/0xc86deac208337d29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1b6 expref: 21 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580067.538573:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8fae530b1300) 00010000:00010000:3.0:1787580067.538576:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787580067.538585:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae5f6d7c00, rc 0) 00000100:00100000:3.0:1787580067.538702:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae504b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+21:10523:x1874413239709952:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 1827us (2861us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1787580067.538712:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 86 00000100:00100000:3.0:1787580067.546043:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580067.546141:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239710080 00000100:00100000:2.0:1787580067.546154:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239710080 00000100:00100000:2.0:1787580067.546318:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 87 00000100:00100000:2.0:1787580067.546331:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7efc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+21:10523:x1874413239710080:12345-192.168.202.36@tcp:54:lfs.0 00010000:00010000:2.0:1787580067.547365:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208337d37 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580067.547410:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208337d37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580067.547495:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208337d37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580067.547529:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208337d37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580067.547537:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208337d37 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580067.547544:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208337d37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580067.547550:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db9c00 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:2.0:1787580067.547554:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208337d37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580067.547578:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208337d37 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580067.547590:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8fae530b1300) 00010000:00010000:2.0:1787580067.547910:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787580067.547915:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208337d37 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580067.547922:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208337d37 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580067.548317:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7efc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+21:10523:x1874413239710080:12345-192.168.202.36@tcp:54:lfs.0 Request processed in 1984us (3321us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580067.548327:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 87 00000100:00100000:0.0:1787580067.555375:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580067.558948:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239710336 00000100:00100000:3.0:1787580067.558966:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239710336 00000100:00100000:2.0:1787580067.559222:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 21 00000100:00100000:2.0:1787580067.559236:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51884050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+21:10523:x1874413239710336:12345-192.168.202.36@tcp:35:lfs.0 00000100:00100000:2.0:1787580067.559841:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51884050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+22:10523:x1874413239710336:12345-192.168.202.36@tcp:35:lfs.0 Request processed in 606us (4473us total) trans 4294967365 rc 0/0 00000100:00100000:2.0:1787580067.559849:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 21 00000100:00100000:0.0:1787580067.603870:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580067.604291:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239710592 00000100:00100000:3.0:1787580067.604303:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239710592 00000100:00100000:3.0:1787580067.604371:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 88 00000100:00100000:3.0:1787580067.604425:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae504b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+22:10030:x1874413239710592:12345-192.168.202.36@tcp:101:bash.0 00010000:00010000:3.0:1787580067.604452:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787580067.604474:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6800/0xc86deac208337d3e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d1bd expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580067.604583:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7600/0xc86deac208337d45 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580067.604598:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7c00/0xc86deac208337d29 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1b6 expref: 23 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580067.604606:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7600/0xc86deac208337d45 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580067.604639:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7c00/0xc86deac208337d29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1b6 expref: 23 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580067.604652:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7c00/0xc86deac208337d29 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1b6 expref: 23 pid: 5853 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580067.604677:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7efcbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5854:1874413262801792:192.168.202.36@tcp:104: 00000100:00100000:3.0:1787580067.604770:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae51e92300 going to sleep for 11 seconds 00000100:00100000:0.0:1787580067.607475:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7efcbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5854:1874413262801792:192.168.202.36@tcp:104: 00010000:00010000:0.0:1787580067.607504:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7600/0xc86deac208337d45 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580067.609371:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580067.610329:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239710720 00000100:00100000:1.0:1787580067.610343:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239710720 00010000:00010000:1.0:1787580067.610414:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7c00/0xc86deac208337d29 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1b6 expref: 24 pid: 5853 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580067.610463:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 47 00000100:00100000:1.0:1787580067.610474:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae504b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+24:2361:x1874413239710720:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787580067.610491:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787580067.610498:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7c00/0xc86deac208337d29 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1b6 expref: 24 pid: 5853 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580067.610539:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7c00/0xc86deac208337d29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1b6 expref: 24 pid: 5853 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580067.610562:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7c00/0xc86deac208337d29 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1b6 expref: 24 pid: 5853 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580067.610581:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8fae530b1300) 00010000:00010000:1.0:1787580067.610586:0:5838:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7600/0xc86deac208337d45 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580067.610595:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7600/0xc86deac208337d45 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580067.610602:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7600/0xc86deac208337d45 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580067.610650:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787580067.610722:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae504b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+23:2361:x1874413239710720:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 248us (1360us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580067.610739:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 47 00010000:00010000:0.0:1787580067.611095:0:5854:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7600/0xc86deac208337d45 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580067.611105:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7600/0xc86deac208337d45 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787580067.611129:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1787580067.611309:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6800/0xc86deac208337d3e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1bd expref: 24 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580067.611325:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7600/0xc86deac208337d45 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1bd expref: 23 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580067.611334:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8fae530b1300) 00010000:00010000:0.0:1787580067.611336:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787580067.611339:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae5f6d7600, rc 0) 00000100:00100000:0.0:1787580067.611367:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae504b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+23:10030:x1874413239710592:12345-192.168.202.36@tcp:101:bash.0 Request processed in 6988us (7517us total) trans 4294967366 rc 0/0 00000100:00100000:0.0:1787580067.611374:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 88 00000100:00100000:3.0:1787580067.616322:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580067.617512:0:8897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239710976 00000100:00100000:1.0:1787580067.617525:0:8897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239710976 00000100:00100000:1.0:1787580067.617701:0:8897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 89 00000100:00100000:1.0:1787580067.617713:0:8897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7efc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+23:10030:x1874413239710976:12345-192.168.202.36@tcp:36:bash.0 00010000:00010000:1.0:1787580067.618472:0:8897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661600/0xc86deac208337d53 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580067.618491:0:8897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661600/0xc86deac208337d53 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580067.618519:0:8897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661600/0xc86deac208337d53 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787580067.618571:0:8897:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:1.0:1787580067.618593:0:8897:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003a9db4ce reply state 00000000c49a406d transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661600/0xc86deac208337d53 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580067.618601:0:8897:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1787580067.618711:0:8897:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:1.0:1787580067.619050:0:8897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7efc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+27:10030:x1874413239710976:12345-192.168.202.36@tcp:36:bash.0 Request processed in 1337us (2736us total) trans 4294967369 rc 0/0 00000100:00100000:1.0:1787580067.619058:0:8897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 89 00000020:00080000:1.0:1787580067.619063:0:8897:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:0.0:1787580067.622592:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661600/0xc86deac208337d53 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580067.622714:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00010000:00010000:0.0:1787580067.622864:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661600/0xc86deac208337d53 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580067.622891:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661600/0xc86deac208337d53 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580067.622896:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae41661600 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:0.0:1787580067.622901:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661600/0xc86deac208337d53 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580067.622909:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661600/0xc86deac208337d53 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580067.622942:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8fae530b1300) 00010000:00010000:0.0:1787580067.622945:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787580067.622950:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661600/0xc86deac208337d53 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580067.622956:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661600/0xc86deac208337d53 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580067.623287:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239711104 00000100:00100000:3.0:1787580067.623299:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239711104 00000100:00100000:3.0:1787580067.623358:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 90 00000100:00100000:3.0:1787580067.623369:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5f6ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+26:10030:x1874413239711104:12345-192.168.202.36@tcp:101:bash.0 00010000:00010000:3.0:1787580067.623543:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787580067.623561:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7e00/0xc86deac208337d5a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d1c4 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580067.623710:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7e00/0xc86deac208337d5a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1c4 expref: 27 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580067.623726:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7e00/0xc86deac208337d5a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1c4 expref: 27 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580067.623878:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8fae530b1300) 00010000:00010000:3.0:1787580067.623881:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787580067.623885:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae5f6d7e00, rc 0) 00000100:00100000:3.0:1787580067.624044:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5f6ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+27:10030:x1874413239711104:12345-192.168.202.36@tcp:101:bash.0 Request processed in 676us (1333us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580067.624051:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 90 00000100:00100000:0.0:1787580067.626749:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580067.626927:0:10268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239711232 00000100:00100000:3.0:1787580067.626937:0:10268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239711232 00000100:00100000:3.0:1787580067.627039:0:10268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 33 00000100:00100000:3.0:1787580067.627049:0:10268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae504b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:10030:x1874413239711232:12345-192.168.202.36@tcp:101:bash.0 00010000:00010000:3.0:1787580067.627065:0:10268:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787580067.627085:0:10268:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080997781/0xc86deac208337d61 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d1cb expref: -99 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787580067.627111:0:10268:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a8c4e9f, atime: 0x6a8c4e9e, ctime: 0x6a8c4e9f, blocks: 0xb 00010000:00010000:3.0:1787580067.627131:0:10268:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=415s v=(0 0) 00010000:00010000:3.0:1787580067.627136:0:10268:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787580067.627144:0:10268:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080997781/0xc86deac208337d61 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1cb expref: 7 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580067.627160:0:10268:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000080997781/0xc86deac208337d61 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1cb expref: 7 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580067.627173:0:10268:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae5f6d6e00, rc 0) 00000100:00080000:2.0:1787580067.627338:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787580067.627453:0:10268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae504b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+7:10030:x1874413239711232:12345-192.168.202.36@tcp:101:bash.0 Request processed in 404us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580067.627460:0:10268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 33 00000100:00100000:2.0:1787580067.630760:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580067.630899:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239711360 00000100:00100000:3.0:1787580067.630909:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239711360 00002000:00010000:3.0:1787580067.630961:0:6711:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:3.0:1787580067.630967:0:6711:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8fae5f6fd880 with x1874413239711360 ext(0->18446744073709551615) 00002000:00010000:3.0:1787580067.630980:0:6711:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8fae5f6fd880. 00000100:00100000:3.0:1787580067.631025:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 1 00000100:00100000:3.0:1787580067.631035:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5f6fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+7:2359:x1874413239711360:12345-192.168.202.36@tcp:10:bash.0 00002000:00010000:3.0:1787580067.631556:0:6711:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1787580067.631560:0:6711:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1787580063 -> 1787580067 00002000:00010000:3.0:1787580067.631564:0:6711:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1787580062 -> 1787580062 00002000:00010000:3.0:1787580067.631566:0:6711:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1787580063 -> 1787580067 00002000:00010000:3.0:1787580067.631568:0:6711:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1787580067.631945:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5f6fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+8:2359:x1874413239711360:12345-192.168.202.36@tcp:10:bash.0 Request processed in 907us (1191us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1787580067.631954:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 1 00002000:00010000:3.0:1787580067.631958:0:6711:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:3.0:1787580067.631961:0:6711:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8fae5f6fd880 with x1874413239711360 ext(0->18446744073709551615) 00002000:00010000:3.0:1787580067.631967:0:6711:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8fae5f6fd880. 00000100:00100000:2.0:1787580067.745648:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580067.746113:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239711488 00000100:00100000:3.0:1787580067.746124:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239711488 00000100:00100000:3.0:1787580067.746187:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 91 00000100:00100000:3.0:1787580067.746196:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5f6fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+27:10537:x1874413239711488:12345-192.168.202.36@tcp:34:lfs.0 00010000:00010000:3.0:1787580067.746273:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6600/0xc86deac208337d68 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580067.746292:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6600/0xc86deac208337d68 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580067.746304:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6600/0xc86deac208337d68 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580067.746321:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6200/0xc86deac208337d6f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580067.746328:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6200/0xc86deac208337d6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580067.746349:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6200/0xc86deac208337d6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580067.747687:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac208337d76 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580067.747706:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac208337d76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580067.747726:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac208337d76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787580067.747863:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac208337d76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580067.748087:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6600/0xc86deac208337d68 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580067.748095:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6600/0xc86deac208337d68 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580067.748102:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6600/0xc86deac208337d68 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580067.748108:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae5f6d6600 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:2.0:1787580067.748113:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6600/0xc86deac208337d68 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580067.748120:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6600/0xc86deac208337d68 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580067.748135:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8fae5bb2f900) 00010000:00010000:2.0:1787580067.748138:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787580067.748144:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6600/0xc86deac208337d68 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580067.748151:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6600/0xc86deac208337d68 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580067.748167:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6200/0xc86deac208337d6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580067.748181:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6200/0xc86deac208337d6f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580067.748186:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6200/0xc86deac208337d6f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580067.748192:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae5f6d6200 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:2.0:1787580067.748195:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6200/0xc86deac208337d6f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580067.748201:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6200/0xc86deac208337d6f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580067.748210:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8fae530b1200) 00010000:00010000:2.0:1787580067.748212:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787580067.748215:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6200/0xc86deac208337d6f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580067.748222:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6200/0xc86deac208337d6f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580067.748238:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac208337d76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580067.748245:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac208337d76 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580067.748252:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac208337d76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580067.748257:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db8200 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:2.0:1787580067.748265:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac208337d76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580067.748271:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac208337d76 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580067.748278:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8fae530b1300) 00010000:00010000:2.0:1787580067.748280:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787580067.748283:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac208337d76 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580067.748288:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac208337d76 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580067.748378:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5f6fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+27:10537:x1874413239711488:12345-192.168.202.36@tcp:34:lfs.0 Request processed in 2178us (2736us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580067.748867:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 91 00000100:00100000:0.0:1787580067.815062:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580067.815231:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239711744 00000100:00100000:3.0:1787580067.815242:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239711744 00000100:00100000:3.0:1787580067.815309:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 92 00000100:00100000:3.0:1787580067.815319:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d5bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+27:10540:x1874413239711744:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:3.0:1787580067.815342:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787580067.815362:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7800/0xc86deac208337d7d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d1d2 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580067.815478:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7400/0xc86deac208337d84 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580067.815494:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7400/0xc86deac208337d84 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580067.815505:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7400/0xc86deac208337d84 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580067.815533:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6000/0xc86deac208337d8b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580067.815541:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6000/0xc86deac208337d8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580067.815548:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6000/0xc86deac208337d8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580067.816188:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6a00/0xc86deac208337d92 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580067.816207:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6a00/0xc86deac208337d92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580067.816215:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6a00/0xc86deac208337d92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787580067.816226:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1787580067.816325:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7400/0xc86deac208337d84 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580067.816332:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7400/0xc86deac208337d84 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580067.816339:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7400/0xc86deac208337d84 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580067.816345:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae5f6d7400 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:3.0:1787580067.816350:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7400/0xc86deac208337d84 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580067.816357:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7400/0xc86deac208337d84 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580067.816370:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8fae5bb2f900) 00010000:00010000:3.0:1787580067.816374:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787580067.816378:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7400/0xc86deac208337d84 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580067.816411:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7400/0xc86deac208337d84 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580067.816425:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6000/0xc86deac208337d8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580067.816439:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6000/0xc86deac208337d8b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580067.816445:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6000/0xc86deac208337d8b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580067.816451:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae5f6d6000 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:3.0:1787580067.816454:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6000/0xc86deac208337d8b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580067.816461:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6000/0xc86deac208337d8b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580067.816470:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8fae530b1c00) 00010000:00010000:3.0:1787580067.816472:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787580067.816475:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6000/0xc86deac208337d8b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580067.816481:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6000/0xc86deac208337d8b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580067.816589:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7800/0xc86deac208337d7d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1d2 expref: 30 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580067.816604:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6a00/0xc86deac208337d92 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1d2 expref: 29 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580067.816611:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8fae530b1300) 00010000:00010000:3.0:1787580067.816613:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787580067.816622:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae5f6d6a00, rc 0) 00000100:00100000:3.0:1787580067.816697:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d5bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+29:10540:x1874413239711744:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 1377us (1646us total) trans 4294967370 rc 0/0 00000100:00100000:3.0:1787580067.816706:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 92 00000100:00100000:3.0:1787580067.829582:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580067.829693:0:8897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239711872 00000100:00100000:1.0:1787580067.829705:0:8897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239711872 00000100:00100000:1.0:1787580067.829774:0:8897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 93 00000100:00100000:1.0:1787580067.829785:0:8897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7efcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+29:10540:x1874413239711872:12345-192.168.202.36@tcp:54:lfs.0 00010000:00010000:1.0:1787580067.829865:0:8897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661200/0xc86deac208337da0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580067.829892:0:8897:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7600/0xc86deac208337d45 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1bd expref: 29 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580067.829903:0:8897:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661200/0xc86deac208337da0 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580067.829951:0:8897:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7600/0xc86deac208337d45 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1bd expref: 29 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580067.829983:0:8897:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7600/0xc86deac208337d45 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1bd expref: 29 pid: 5854 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580067.830010:0:8897:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae74ed1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8897:1874413262801920:192.168.202.36@tcp:104: 00000100:00100000:1.0:1787580067.830115:0:8897:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae49ef0300 going to sleep for 11 seconds 00000100:00100000:2.0:1787580067.834781:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580067.834941:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239712128 00000100:00100000:3.0:1787580067.834952:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239712128 00000100:00100000:3.0:1787580067.835019:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 22 00000100:00100000:3.0:1787580067.835030:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5f6ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+30:5600:x1874413239712128:12345-192.168.202.36@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787580067.835413:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5f6ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+31:5600:x1874413239712128:12345-192.168.202.36@tcp:35:ldlm_bl.0 Request processed in 352us (614us total) trans 4294967371 rc 0/0 00000100:00100000:3.0:1787580067.835421:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 22 00000100:00100000:1.0:1787580067.836249:0:8897:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae74ed1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8897:1874413262801920:192.168.202.36@tcp:104: 00010000:00010000:1.0:1787580067.836286:0:8897:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661200/0xc86deac208337da0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580067.844341:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580067.844645:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239712256 00000100:00100000:3.0:1787580067.844655:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239712256 00010000:00010000:3.0:1787580067.844695:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7600/0xc86deac208337d45 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1bd expref: 31 pid: 5854 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580067.844787:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 48 00000100:00100000:3.0:1787580067.844797:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d5b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+31:2361:x1874413239712256:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787580067.844823:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787580067.844831:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7600/0xc86deac208337d45 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1bd expref: 31 pid: 5854 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580067.844845:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7600/0xc86deac208337d45 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1bd expref: 31 pid: 5854 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580067.844868:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7600/0xc86deac208337d45 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1bd expref: 31 pid: 5854 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580067.844915:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8fae530b1300) 00010000:00010000:3.0:1787580067.844921:0:5840:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661200/0xc86deac208337da0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580067.844932:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661200/0xc86deac208337da0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580067.844940:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661200/0xc86deac208337da0 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580067.844975:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787580067.845044:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d5b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+30:2361:x1874413239712256:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 248us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580067.845051:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 48 00010000:00010000:0.0:1787580067.846244:0:8897:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661200/0xc86deac208337da0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580067.846259:0:8897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661200/0xc86deac208337da0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580067.846296:0:8897:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661200/0xc86deac208337da0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580067.846303:0:8897:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661200/0xc86deac208337da0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580067.846325:0:8897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661200/0xc86deac208337da0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580067.846332:0:8897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae41661200 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:0.0:1787580067.846336:0:8897:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661200/0xc86deac208337da0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580067.846344:0:8897:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661200/0xc86deac208337da0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580067.846359:0:8897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8fae530b1300) 00010000:00010000:0.0:1787580067.846362:0:8897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787580067.846365:0:8897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661200/0xc86deac208337da0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580067.846371:0:8897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661200/0xc86deac208337da0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580067.846497:0:8897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7efcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+29:10540:x1874413239711872:12345-192.168.202.36@tcp:54:lfs.0 Request processed in 16709us (16922us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580067.846507:0:8897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 93 00000100:00100000:0.0:1787580067.853631:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580067.854550:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239712512 00000100:00100000:3.0:1787580067.854564:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239712512 00000100:00100000:2.0:1787580067.854702:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 23 00000100:00100000:2.0:1787580067.854715:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d5bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+29:10540:x1874413239712512:12345-192.168.202.36@tcp:35:lfs.0 00000100:00100000:2.0:1787580067.855319:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d5bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+30:10540:x1874413239712512:12345-192.168.202.36@tcp:35:lfs.0 Request processed in 604us (1696us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1787580067.855328:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 23 00000100:00100000:2.0:1787580067.974148:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580067.974208:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239712768 00000100:00100000:2.0:1787580067.974219:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239712768 00000100:00100000:2.0:1787580067.974279:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 94 00000100:00100000:2.0:1787580067.974291:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5f6fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+30:10551:x1874413239712768:12345-192.168.202.36@tcp:101:cat.0 00010000:00010000:2.0:1787580067.974339:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787580067.974364:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac208337da7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d1d9 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580067.974450:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8600/0xc86deac208337dae lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580067.974465:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8600/0xc86deac208337dae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580067.974475:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8600/0xc86deac208337dae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580067.974488:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac208337db5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580067.974494:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac208337db5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580067.974500:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac208337db5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580067.975013:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8400/0xc86deac208337dbc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580067.975024:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8400/0xc86deac208337dbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580067.975031:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8400/0xc86deac208337dbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787580067.975042:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:2.0:1787580067.975145:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8600/0xc86deac208337dae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580067.975153:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8600/0xc86deac208337dae lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580067.975160:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8600/0xc86deac208337dae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580067.975166:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db8600 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:2.0:1787580067.975171:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8600/0xc86deac208337dae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580067.975178:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8600/0xc86deac208337dae lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580067.975190:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8fae5bb2f900) 00010000:00010000:2.0:1787580067.975193:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787580067.975197:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8600/0xc86deac208337dae lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580067.975203:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8600/0xc86deac208337dae lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580067.975215:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac208337db5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580067.975221:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac208337db5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580067.975226:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac208337db5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580067.975231:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db8200 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:2.0:1787580067.975241:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac208337db5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580067.975247:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac208337db5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580067.975256:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8fae4c7d9f00) 00010000:00010000:2.0:1787580067.975258:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787580067.975261:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac208337db5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580067.975267:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac208337db5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580067.975313:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac208337da7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1d9 expref: 33 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580067.975328:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8400/0xc86deac208337dbc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1d9 expref: 32 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580067.975335:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8fae530b1300) 00010000:00010000:2.0:1787580067.975337:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787580067.975340:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae48db8400, rc 0) 00000100:00100000:2.0:1787580067.975444:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5f6fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+32:10551:x1874413239712768:12345-192.168.202.36@tcp:101:cat.0 Request processed in 1155us (1307us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1787580067.975453:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 94 00000100:00100000:1.0:1787580067.981512:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580067.982350:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239713024 00000100:00100000:2.0:1787580067.982361:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239713024 00000100:00100000:2.0:1787580067.982445:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 24 00000100:00100000:2.0:1787580067.982458:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74ed1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+32:10551:x1874413239713024:12345-192.168.202.36@tcp:35:cat.0 00000100:00100000:2.0:1787580067.982732:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74ed1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+33:10551:x1874413239713024:12345-192.168.202.36@tcp:35:cat.0 Request processed in 275us (1237us total) trans 4294967374 rc 0/0 00000100:00100000:2.0:1787580067.982740:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 24 00000100:00100000:1.0:1787580068.037932:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580068.038120:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239713280 00000100:00100000:3.0:1787580068.038134:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239713280 00000100:00100000:3.0:1787580068.038211:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 95 00000100:00100000:3.0:1787580068.038223:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51caf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+33:10552:x1874413239713280:12345-192.168.202.36@tcp:36:rm.0 00010000:00010000:3.0:1787580068.038292:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787580068.038321:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8400/0xc86deac208337dbc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1d9 expref: 33 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580068.038344:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6a00/0xc86deac208337d92 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1d2 expref: 32 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580068.038356:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7e00/0xc86deac208337d5a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1c4 expref: 31 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580068.038379:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8fae530b1300) 00010000:00010000:3.0:1787580068.038418:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787580068.038440:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7800/0xc86deac208337dca lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580068.038452:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7800/0xc86deac208337dca lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580068.038461:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7800/0xc86deac208337dca lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580068.038473:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7600/0xc86deac208337dd1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580068.038479:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7600/0xc86deac208337dd1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580068.038485:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7600/0xc86deac208337dd1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580068.043224:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6000/0xc86deac208337dd8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580068.043250:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6000/0xc86deac208337dd8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580068.043263:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6000/0xc86deac208337dd8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787580068.045977:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:3.0:1787580068.046003:0:5852:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 415801619536ns, next at 416801615116ns, rc = 0 00010000:00010000:3.0:1787580068.046087:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7400/0xc86deac208337ddf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580068.046099:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7400/0xc86deac208337ddf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580068.046107:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7400/0xc86deac208337ddf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580068.046112:0:5852:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7400/0xc86deac208337ddf lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580068.046116:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7400/0xc86deac208337ddf lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580068.046120:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7400/0xc86deac208337ddf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580068.046133:0:5852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787580068.046155:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6000/0xc86deac208337dd8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580068.046167:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6000/0xc86deac208337dd8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580068.046171:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6000/0xc86deac208337dd8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580068.046175:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae5f6d6000 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:3.0:1787580068.046179:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6000/0xc86deac208337dd8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580068.046183:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6000/0xc86deac208337dd8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580068.046198:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8fae530b1c00) 00010000:00010000:3.0:1787580068.046200:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787580068.046202:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6000/0xc86deac208337dd8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580068.046206:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6000/0xc86deac208337dd8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580068.046220:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7800/0xc86deac208337dca lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580068.046223:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7800/0xc86deac208337dca lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580068.046226:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7800/0xc86deac208337dca lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580068.046230:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae5f6d7800 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:3.0:1787580068.046231:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7800/0xc86deac208337dca lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580068.046234:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7800/0xc86deac208337dca lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580068.046238:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8fae5bb2f900) 00010000:00010000:3.0:1787580068.046239:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787580068.046241:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7800/0xc86deac208337dca lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580068.046244:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7800/0xc86deac208337dca lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787580068.046256:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002d271c2d reply state 00000000843e902b transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7600/0xc86deac208337dd1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580068.046262:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787580068.046351:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51caf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+32:10552:x1874413239713280:12345-192.168.202.36@tcp:36:rm.0 Request processed in 8127us (8423us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1787580068.046360:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 95 00010000:00010000:1.0:1787580068.047116:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787580068.047125:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7400/0xc86deac208337ddf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580068.047134:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae5f6d7400 already unused, calling callback (ffffffffc155a230) 00010000:00010000:1.0:1787580068.047138:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7400/0xc86deac208337ddf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580068.047145:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7400/0xc86deac208337ddf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580068.047166:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8fae530b1c00) 00010000:00010000:1.0:1787580068.047169:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787580068.047173:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7400/0xc86deac208337ddf lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580068.047179:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7400/0xc86deac208337ddf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580068.047208:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787580068.047210:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787580068.047212:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787580068.050240:0:6733:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00080000:2.0:1787580068.050270:0:6733:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00010000:00010000:2.0:1787580068.055969:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7600/0xc86deac208337dd1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580068.056001:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7600/0xc86deac208337dd1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580068.056008:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7600/0xc86deac208337dd1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580068.056014:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae5f6d7600 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:2.0:1787580068.056019:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7600/0xc86deac208337dd1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580068.056026:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7600/0xc86deac208337dd1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580068.056046:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8fae530b1200) 00010000:00010000:2.0:1787580068.056049:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787580068.056055:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7600/0xc86deac208337dd1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580068.056061:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7600/0xc86deac208337dd1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580068.110117:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580068.110275:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239713536 00000100:00100000:0.0:1787580068.110286:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239713536 00000100:00100000:0.0:1787580068.110365:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 96 00000100:00100000:0.0:1787580068.110377:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51cae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+31:10558:x1874413239713536:12345-192.168.202.36@tcp:101:bash.0 00010000:00010000:0.0:1787580068.110444:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787580068.110468:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea400/0xc86deac208337de6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d1e0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.110623:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feaa00/0xc86deac208337ded lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.110639:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feaa00/0xc86deac208337ded lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.110651:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feaa00/0xc86deac208337ded lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.110666:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea800/0xc86deac208337df4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.110673:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea800/0xc86deac208337df4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.110680:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea800/0xc86deac208337df4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787580068.111271:0:5854:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:0.0:1787580068.111473:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac208337dfb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.111485:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac208337dfb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.111493:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac208337dfb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.111532:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feaa00/0xc86deac208337ded lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.111550:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feaa00/0xc86deac208337ded lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.111557:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feaa00/0xc86deac208337ded lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.111563:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae50feaa00 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:0.0:1787580068.111568:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feaa00/0xc86deac208337ded lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.111575:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feaa00/0xc86deac208337ded lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.111588:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8fae5bb2f900) 00010000:00010000:0.0:1787580068.111591:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787580068.111595:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feaa00/0xc86deac208337ded lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.111601:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feaa00/0xc86deac208337ded lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787580068.111614:0:5854:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ffb4be9d reply state 0000000099827df2 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea800/0xc86deac208337df4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580068.111623:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787580068.111651:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea400/0xc86deac208337de6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1e0 expref: 34 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.111664:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac208337dfb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1e0 expref: 33 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.111682:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8fae56e35400) 00010000:00010000:0.0:1787580068.111684:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787580068.111686:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae50feb600, rc 0) 00000100:00100000:0.0:1787580068.111754:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51cae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+34:10558:x1874413239713536:12345-192.168.202.36@tcp:101:bash.0 Request processed in 1378us (1652us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1787580068.111763:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 96 00000100:00100000:3.0:1787580068.115054:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580068.115137:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239713664 00000100:00100000:1.0:1787580068.115148:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239713664 00000100:00100000:1.0:1787580068.115226:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 34 00000100:00100000:1.0:1787580068.115236:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7efcb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+5:2361:x1874413239713664:12345-192.168.202.36@tcp:101:bash.0 00010000:00010000:1.0:1787580068.115254:0:6707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787580068.115276:0:6707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003590f4d0/0xc86deac208337e09 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d1e7 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787580068.115301:0:6707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787580068.115319:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=415s v=(0 0) 00010000:00010000:1.0:1787580068.115334:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787580068.115345:0:6707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003590f4d0/0xc86deac208337e09 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1e7 expref: 6 pid: 6707 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580068.115365:0:6707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003590f4d0/0xc86deac208337e09 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1e7 expref: 6 pid: 6707 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580068.115378:0:6707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae41660600, rc 0) 00000100:00100000:1.0:1787580068.115455:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7efcb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:2361:x1874413239713664:12345-192.168.202.36@tcp:101:bash.0 Request processed in 219us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580068.115462:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 34 00000100:00080000:2.0:1787580068.115660:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787580068.118021:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea800/0xc86deac208337df4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.118038:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea800/0xc86deac208337df4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.118045:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea800/0xc86deac208337df4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.118051:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae50fea800 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:0.0:1787580068.118056:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea800/0xc86deac208337df4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.118064:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea800/0xc86deac208337df4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.118081:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8fae56e35f00) 00010000:00010000:0.0:1787580068.118084:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787580068.118089:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea800/0xc86deac208337df4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.118095:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea800/0xc86deac208337df4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580068.120109:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580068.120208:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239713792 00000100:00100000:0.0:1787580068.120221:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239713792 00000100:00100000:0.0:1787580068.120288:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 35 00000100:00100000:0.0:1787580068.120299:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7efc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:10558:x1874413239713792:12345-192.168.202.36@tcp:101:bash.0 00010000:00010000:0.0:1787580068.120337:0:6705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787580068.120358:0:6705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000041801157/0xc86deac208337e10 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d1ee expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.120423:0:6705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003590f4d0/0xc86deac208337e09 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1e7 expref: 7 pid: 6707 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.120431:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787580068.120436:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787580068.120442:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000041801157/0xc86deac208337e10 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1ee expref: 7 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.120477:0:6705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003590f4d0/0xc86deac208337e09 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1e7 expref: 7 pid: 6707 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.120491:0:6705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003590f4d0/0xc86deac208337e09 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1e7 expref: 7 pid: 6707 timeout: 515 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580068.120505:0:6705:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d5ba680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6705:1874413262802048:192.168.202.36@tcp:104: 00000100:00100000:0.0:1787580068.120594:0:6705:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae77a2f300 going to sleep for 11 seconds 00000100:00100000:1.0:1787580068.135620:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580068.135754:0:6705:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d5ba680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6705:1874413262802048:192.168.202.36@tcp:104: 00010000:00010000:0.0:1787580068.135797:0:6705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000041801157/0xc86deac208337e10 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1ee expref: 7 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.135821:0:6705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae50feb800, rc 0) 00000100:00100000:0.0:1787580068.135881:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7efc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+7:10558:x1874413239713792:12345-192.168.202.36@tcp:101:bash.0 Request processed in 15584us (15784us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580068.135888:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 35 00000100:00100000:3.0:1787580068.135969:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239713920 00000100:00100000:3.0:1787580068.135977:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239713920 00010000:00010000:3.0:1787580068.136049:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003590f4d0/0xc86deac208337e09 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1e7 expref: 7 pid: 6707 timeout: 515 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580068.136127:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 49 00000100:00100000:3.0:1787580068.136137:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae52136850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+7:2361:x1874413239713920:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787580068.136150:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787580068.136178:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003590f4d0/0xc86deac208337e09 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1e7 expref: 7 pid: 6707 timeout: 515 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580068.136191:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003590f4d0/0xc86deac208337e09 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1e7 expref: 7 pid: 6707 timeout: 515 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580068.136215:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003590f4d0/0xc86deac208337e09 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1e7 expref: 7 pid: 6707 timeout: 515 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580068.136246:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787580068.136251:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787580068.136261:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000041801157/0xc86deac208337e10 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1ee expref: 6 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580068.136271:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000041801157/0xc86deac208337e10 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1ee expref: 6 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580068.136308:0:5839:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000041801157/0xc86deac208337e10 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1ee expref: 6 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580068.136323:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7efcad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5839:1874413262802176:192.168.202.36@tcp:105: 00000100:00100000:3.0:1787580068.136377:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae436f8300 going to sleep for 11 seconds 00000100:00100000:3.0:1787580068.139687:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7efcad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5839:1874413262802176:192.168.202.36@tcp:105: 00010000:00010000:3.0:1787580068.139715:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787580068.139771:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae52136850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:2361:x1874413239713920:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 3635us (4170us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580068.139782:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 49 00000100:00100000:1.0:1787580068.147514:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580068.149003:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239714176 00000100:00100000:2.0:1787580068.149018:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239714176 00000100:00100000:2.0:1787580068.149090:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 25 00000100:00100000:2.0:1787580068.149101:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51cac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+33:10558:x1874413239714176:12345-192.168.202.36@tcp:35:bash.0 00000100:00100000:2.0:1787580068.149515:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51cac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+34:10558:x1874413239714176:12345-192.168.202.36@tcp:35:bash.0 Request processed in 414us (2010us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1787580068.149523:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 25 00000100:00100000:1.0:1787580068.336057:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580068.336243:0:8897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239714304 00000100:00100000:0.0:1787580068.336253:0:8897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239714304 00000100:00100000:0.0:1787580068.336317:0:8897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 97 00000100:00100000:0.0:1787580068.337115:0:8897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51caca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+34:10574:x1874413239714304:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:0.0:1787580068.337142:0:8897:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787580068.337165:0:8897:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea800/0xc86deac208337e17 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d1f5 expref: -99 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.337232:0:8897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea400/0xc86deac208337e1e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.337247:0:8897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea400/0xc86deac208337e1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.337261:0:8897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea400/0xc86deac208337e1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787580068.337333:0:8897:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1787580068.337337:0:8897:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787580068.337360:0:8897:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea400/0xc86deac208337e1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.337425:0:8897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea800/0xc86deac208337e17 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1f5 expref: 36 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.337445:0:8897:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea400/0xc86deac208337e1e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1f5 expref: 35 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.337453:0:8897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8fae5bb2f900) 00010000:00010000:0.0:1787580068.337456:0:8897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787580068.337460:0:8897:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae50fea400, rc 0) 00000100:00100000:0.0:1787580068.337526:0:8897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51caca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+35:10574:x1874413239714304:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 419us (1480us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580068.346739:0:8897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 97 00010000:00010000:0.0:1787580068.346833:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787580068.355679:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580068.355828:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239714560 00000100:00100000:0.0:1787580068.355842:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239714560 00000100:00100000:0.0:1787580068.355918:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 98 00000100:00100000:0.0:1787580068.355929:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51cadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+35:10574:x1874413239714560:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:0.0:1787580068.355950:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787580068.355972:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea800/0xc86deac208337e25 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d1fc expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.356234:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feaa00/0xc86deac208337e2c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.356248:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feaa00/0xc86deac208337e2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.356259:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feaa00/0xc86deac208337e2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787580068.356284:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1787580068.356473:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea800/0xc86deac208337e25 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1fc expref: 38 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.356494:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feaa00/0xc86deac208337e2c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1fc expref: 37 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.356503:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8fae56e35400) 00010000:00010000:0.0:1787580068.356505:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787580068.356510:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae50feaa00, rc 0) 00000100:00100000:0.0:1787580068.356569:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51cadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+37:10574:x1874413239714560:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 641us (900us total) trans 4294967378 rc 0/0 00000100:00100000:0.0:1787580068.356577:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 98 00000100:00100000:1.0:1787580068.360028:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580068.360193:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239714816 00000100:00100000:3.0:1787580068.360204:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239714816 00000100:00100000:3.0:1787580068.360267:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 99 00000100:00100000:3.0:1787580068.360278:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7efdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+37:10574:x1874413239714816:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:3.0:1787580068.360304:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787580068.360336:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7800/0xc86deac208337e3a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d203 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580068.360496:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6000/0xc86deac208337e41 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580068.360513:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6000/0xc86deac208337e41 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580068.360524:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6000/0xc86deac208337e41 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787580068.360537:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1787580068.360677:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7800/0xc86deac208337e3a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d203 expref: 40 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580068.360694:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6000/0xc86deac208337e41 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d203 expref: 39 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580068.360702:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8fae56e35400) 00010000:00010000:3.0:1787580068.360704:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787580068.360708:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae5f6d6000, rc 0) 00000100:00100000:3.0:1787580068.360765:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7efdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+39:10574:x1874413239714816:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 488us (747us total) trans 4294967379 rc 0/0 00000100:00100000:3.0:1787580068.360771:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 99 00000100:00100000:1.0:1787580068.361102:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580068.361933:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239714944 00000100:00100000:3.0:1787580068.361942:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239714944 00000100:00100000:3.0:1787580068.362009:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 6 00000100:00100000:3.0:1787580068.362018:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae50728a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+39:2360:x1874413239714944:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787580068.362030:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787580068.362062:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feaa00/0xc86deac208337e2c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1fc expref: 39 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580068.362076:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8fae56e35400) 00010000:00010000:3.0:1787580068.362080:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787580068.362273:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae50728a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+38:2360:x1874413239714944:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 255us (1180us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580068.362280:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 6 00000100:00100000:1.0:1787580068.385944:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580068.386063:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239715072 00000100:00100000:0.0:1787580068.386073:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239715072 00000100:00100000:0.0:1787580068.386149:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 36 00000100:00100000:0.0:1787580068.386160:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5072b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:2360:x1874413239715072:12345-192.168.202.36@tcp:1:lfs.0 00010000:00010000:0.0:1787580068.386211:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093fbbd4a/0xc86deac208337e4f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.386233:0:6707:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000041801157/0xc86deac208337e10 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1ee expref: 6 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.386243:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1787580068.386247:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787580068.386253:0:6707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000093fbbd4a/0xc86deac208337e4f lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.386305:0:6707:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000041801157/0xc86deac208337e10 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1ee expref: 6 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.386332:0:6707:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000041801157/0xc86deac208337e10 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1ee expref: 6 pid: 6705 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580068.386351:0:6707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d5ba680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6707:1874413262802304:192.168.202.36@tcp:104: 00000100:00100000:0.0:1787580068.386495:0:6707:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae77a2fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1787580068.393591:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580068.393754:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239715200 00000100:00100000:3.0:1787580068.393764:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239715200 00002000:00100000:3.0:1787580068.393817:0:6713:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8fae5f6ffb80 x1874413239715200/t0(0) o4->31d1df27-21ab-4c76-bd19-e53fa778bd7e@192.168.202.36@tcp:554/0 lens 504/0 e 0 to 0 dl 1787580079 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787580068.393829:0:6713:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8fae5f6ffb80 with x1874413239715200 ext(0->8) 00010000:00010000:3.0:1787580068.393840:0:6713:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000041801157/0xc86deac208337e10 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1ee expref: 7 pid: 6705 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580068.393859:0:6713:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000041801157/0xc86deac208337e10 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1ee expref: 7 pid: 6705 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787580068.393867:0:6713:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8fae5f6ffb80 00000100:00100000:3.0:1787580068.393973:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 1 00000100:00100000:3.0:1787580068.393994:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5f6ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+7:2361:x1874413239715200:12345-192.168.202.36@tcp:4:lfs.0 00000100:00100000:0.0:1787580068.394226:0:6707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d5ba680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6707:1874413262802304:192.168.202.36@tcp:104: 00010000:00010000:0.0:1787580068.394251:0:6707:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000093fbbd4a/0xc86deac208337e4f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580068.399144:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5f6ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+9:2361:x1874413239715200:12345-192.168.202.36@tcp:4:lfs.0 Request processed in 5152us (5555us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1787580068.399159:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 1 00002000:00100000:3.0:1787580068.399172:0:6713:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8fae5f6ffb80 x1874413239715200/t4294967302(0) o4->31d1df27-21ab-4c76-bd19-e53fa778bd7e@192.168.202.36@tcp:554/0 lens 504/448 e 0 to 0 dl 1787580079 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787580068.399193:0:6713:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8fae5f6ffb80 with x1874413239715200 ext(0->8) 00010000:00010000:3.0:1787580068.399205:0:6713:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000041801157/0xc86deac208337e10 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1ee expref: 9 pid: 6705 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580068.399227:0:6713:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000041801157/0xc86deac208337e10 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1ee expref: 9 pid: 6705 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787580068.399235:0:6713:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8fae5f6ffb80 00000100:00100000:2.0:1787580068.405827:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580068.406438:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239715328 00000100:00100000:3.0:1787580068.406450:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239715328 00010000:00010000:3.0:1787580068.406494:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000041801157/0xc86deac208337e10 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1ee expref: 9 pid: 6705 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580068.406545:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 50 00000100:00100000:3.0:1787580068.406556:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5f6fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+9:2361:x1874413239715328:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787580068.406574:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787580068.406593:0:5839:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1787580068.406596:0:5839:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787580068 00002000:00010000:3.0:1787580068.406599:0:5839:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787580068 00002000:00010000:3.0:1787580068.406600:0:5839:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1787580068 00010000:00010000:3.0:1787580068.406740:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000041801157/0xc86deac208337e10 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1ee expref: 9 pid: 6705 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580068.406756:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000041801157/0xc86deac208337e10 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1ee expref: 9 pid: 6705 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580068.406797:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000041801157/0xc86deac208337e10 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1ee expref: 9 pid: 6705 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580068.406813:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787580068.406819:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787580068.406825:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000093fbbd4a/0xc86deac208337e4f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580068.406833:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000093fbbd4a/0xc86deac208337e4f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580068.406918:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787580068.406993:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5f6fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+8:2361:x1874413239715328:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 428us (1169us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580068.407002:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 50 00010000:00010000:0.0:1787580068.417251:0:6707:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000093fbbd4a/0xc86deac208337e4f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.417273:0:6707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000093fbbd4a/0xc86deac208337e4f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.417316:0:6707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093fbbd4a/0xc86deac208337e4f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.417325:0:6707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000093fbbd4a/0xc86deac208337e4f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.417358:0:6707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000093fbbd4a/0xc86deac208337e4f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.417365:0:6707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae50fea800 already unused, calling callback (ffffffffc155a230) 00010000:00010000:0.0:1787580068.417369:0:6707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000093fbbd4a/0xc86deac208337e4f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.417378:0:6707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000093fbbd4a/0xc86deac208337e4f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.417422:0:6707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000093fbbd4a/0xc86deac208337e4f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.417430:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000093fbbd4a/0xc86deac208337e4f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580068.417540:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5072b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+7:2360:x1874413239715072:12345-192.168.202.36@tcp:1:lfs.0 Request processed in 31376us (31601us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580068.417551:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 36 00000100:00100000:2.0:1787580068.424895:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580068.425000:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239715584 00000100:00100000:0.0:1787580068.425011:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239715584 00000100:00100000:0.0:1787580068.425079:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 26 00000100:00100000:0.0:1787580068.425090:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51887c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+38:10574:x1874413239715584:12345-192.168.202.36@tcp:35:lfs.0 00000004:00010000:0.0:1787580068.425157:0:5856:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6000/0xc86deac208337e41 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d203 expref: 38 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787580068.425516:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:0.0:1787580068.425562:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:1.0:1787580068.427252:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:1.0:1787580068.427340:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661200/0xc86deac208337e56 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580068.427362:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac208337dfb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1e0 expref: 42 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580068.427371:0:5856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661200/0xc86deac208337e56 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580068.427458:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac208337dfb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1e0 expref: 42 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580068.427475:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac208337dfb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1e0 expref: 42 pid: 5854 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580068.427490:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5072b100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5856:1874413262802432:192.168.202.36@tcp:104: 00000100:00100000:1.0:1787580068.427601:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae49ef0300 going to sleep for 11 seconds 00000100:00100000:1.0:1787580068.434468:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580068.435015:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5072b100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5856:1874413262802432:192.168.202.36@tcp:104: 00010000:00010000:2.0:1787580068.435043:0:5856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661200/0xc86deac208337e56 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580068.435130:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239715712 00000100:00100000:0.0:1787580068.435139:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239715712 00010000:00010000:0.0:1787580068.435187:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac208337dfb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1e0 expref: 43 pid: 5854 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580068.435225:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 51 00000100:00100000:0.0:1787580068.435235:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae50729180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+43:2360:x1874413239715712:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787580068.435250:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787580068.435259:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac208337dfb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1e0 expref: 43 pid: 5854 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.435271:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac208337dfb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1e0 expref: 43 pid: 5854 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.435292:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac208337dfb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1e0 expref: 43 pid: 5854 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.435305:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8fae56e35400) 00010000:00010000:0.0:1787580068.435311:0:5838:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661200/0xc86deac208337e56 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.435330:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661200/0xc86deac208337e56 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.435337:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661200/0xc86deac208337e56 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.435376:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787580068.435475:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae50729180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+42:2360:x1874413239715712:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 240us (1018us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580068.435483:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 51 00010000:00010000:2.0:1787580068.435595:0:5856:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661200/0xc86deac208337e56 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580068.435613:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661200/0xc86deac208337e56 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787580068.435777:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:2.0:1787580068.435981:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:2.0:1787580068.436104:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5f6fce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5856:1874413262802560:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787580068.436156:0:5856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787580068.436191:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae4ce74240 going to sleep for 11 seconds 00000100:00100000:3.0:1787580068.439452:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262802560 00000100:00100000:3.0:1787580068.439468:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262802560 00000100:00080000:2.0:1787580068.439520:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787580068.439559:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787580068.439570:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d661180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5856:x1874413262802560:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787580068.439716:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d661180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5856:x1874413262802560:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 148us (3558us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580068.439725:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787580068.440743:0:5856:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:2.0:1787580068.440752:0:5856:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:2.0:1787580068.440793:0:5856:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8fae5f811500, transno 4294967301 00000100:00100000:2.0:1787580068.440816:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5f6fce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5856:1874413262802560:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787580068.441351:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:2.0:1787580068.441468:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5f6fce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5856:1874413262802688:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787580068.441524:0:5856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787580068.441562:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fad418efb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787580068.441824:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262802688 00000100:00100000:1.0:1787580068.441831:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262802688 00000100:00100000:1.0:1787580068.441876:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787580068.441886:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5f810e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5856:x1874413262802688:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787580068.442087:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5f810e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5856:x1874413262802688:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 202us (562us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1787580068.442095:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787580068.442973:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5f6fce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5856:1874413262802688:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787580068.443055:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:2.0:1787580068.443103:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661200/0xc86deac208337e56 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580068.443113:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661200/0xc86deac208337e56 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580068.443121:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661200/0xc86deac208337e56 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580068.443127:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae41661200 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:2.0:1787580068.443132:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661200/0xc86deac208337e56 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580068.443140:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661200/0xc86deac208337e56 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580068.443156:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8fae56e35400) 00010000:00010000:2.0:1787580068.443159:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787580068.443164:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661200/0xc86deac208337e56 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580068.443170:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661200/0xc86deac208337e56 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787580068.443355:0:5856:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787580068.445185:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:2.0:1787580068.445209:0:5856:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 416200824891ns, next at 417200821295ns, rc = 0 00000001:00080000:2.0:1787580068.445224:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:2.0:1787580068.445292:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8fae56e35400) 00010000:00010000:2.0:1787580068.445297:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787580068.445308:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6000/0xc86deac208337e41 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d203 expref: 46 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580068.448192:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51887c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+45:10574:x1874413239715584:12345-192.168.202.36@tcp:35:lfs.0 Request processed in 23091us (23298us total) trans 4294967388 rc 0/0 00000100:00100000:2.0:1787580068.448205:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 26 00000020:00080000:2.0:1787580068.448212:0:5856:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1787580068.455739:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580068.455912:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239715840 00000100:00100000:0.0:1787580068.455923:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239715840 00000100:00100000:0.0:1787580068.456016:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 100 00000100:00100000:0.0:1787580068.456029:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5072ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+45:10574:x1874413239715840:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:0.0:1787580068.456055:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787580068.456080:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac208337e5d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d20a expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.456140:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac208337e5d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d20a expref: 46 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.456154:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac208337e5d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d20a expref: 46 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.456173:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8fae56e35f00) 00010000:00010000:0.0:1787580068.456177:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787580068.456180:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae50feb600, rc 0) 00000100:00100000:0.0:1787580068.456245:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5072ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+46:10574:x1874413239715840:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 216us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580068.456251:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 100 00000100:00100000:3.0:1787580068.462672:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580068.462818:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239716096 00000100:00100000:2.0:1787580068.462829:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239716096 00000100:00100000:2.0:1787580068.462900:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 27 00000100:00100000:2.0:1787580068.462913:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7efcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+46:10574:x1874413239716096:12345-192.168.202.36@tcp:35:lfs.0 00000100:00100000:2.0:1787580068.463178:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7efcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+47:10574:x1874413239716096:12345-192.168.202.36@tcp:35:lfs.0 Request processed in 267us (515us total) trans 4294967389 rc 0/0 00000100:00100000:2.0:1787580068.463186:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 27 00000100:00100000:3.0:1787580068.583515:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580068.583654:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239716224 00000100:00100000:2.0:1787580068.583665:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239716224 00000100:00100000:2.0:1787580068.583737:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 101 00000100:00100000:2.0:1787580068.583749:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7efca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+47:10584:x1874413239716224:12345-192.168.202.36@tcp:34:lfs.0 00010000:00010000:2.0:1787580068.583839:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8a00/0xc86deac208337e64 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580068.583872:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8a00/0xc86deac208337e64 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580068.583884:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8a00/0xc86deac208337e64 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580068.583900:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9400/0xc86deac208337e6b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580068.583907:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9400/0xc86deac208337e6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580068.583924:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9400/0xc86deac208337e6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580068.584061:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9a00/0xc86deac208337e72 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580068.584070:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9a00/0xc86deac208337e72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580068.584076:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9a00/0xc86deac208337e72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787580068.584119:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9a00/0xc86deac208337e72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580068.584133:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8a00/0xc86deac208337e64 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580068.584139:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8a00/0xc86deac208337e64 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580068.584156:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8a00/0xc86deac208337e64 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580068.584162:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db8a00 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:2.0:1787580068.584166:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8a00/0xc86deac208337e64 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580068.584173:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8a00/0xc86deac208337e64 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580068.584184:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8fae5bb2f900) 00010000:00010000:2.0:1787580068.584187:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787580068.584190:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8a00/0xc86deac208337e64 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580068.584196:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8a00/0xc86deac208337e64 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580068.584208:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9400/0xc86deac208337e6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580068.584214:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9400/0xc86deac208337e6b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580068.584220:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9400/0xc86deac208337e6b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580068.584225:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db9400 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:2.0:1787580068.584227:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9400/0xc86deac208337e6b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580068.584241:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9400/0xc86deac208337e6b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580068.584249:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8fae4c7d9f00) 00010000:00010000:2.0:1787580068.584252:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787580068.584254:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9400/0xc86deac208337e6b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580068.584259:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9400/0xc86deac208337e6b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580068.584274:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9a00/0xc86deac208337e72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580068.584280:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9a00/0xc86deac208337e72 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580068.584286:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9a00/0xc86deac208337e72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580068.584291:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db9a00 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:2.0:1787580068.584294:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9a00/0xc86deac208337e72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580068.584300:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9a00/0xc86deac208337e72 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580068.584307:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8fae56e35f00) 00010000:00010000:2.0:1787580068.584310:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787580068.584312:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9a00/0xc86deac208337e72 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580068.584327:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9a00/0xc86deac208337e72 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580068.584469:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7efca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+47:10584:x1874413239716224:12345-192.168.202.36@tcp:34:lfs.0 Request processed in 720us (963us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580068.584480:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 101 00000100:00100000:3.0:1787580068.636819:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580068.641434:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239716480 00000100:00100000:0.0:1787580068.641450:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239716480 00000100:00100000:0.0:1787580068.641552:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 102 00000100:00100000:0.0:1787580068.641563:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7efc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+47:10587:x1874413239716480:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:0.0:1787580068.641595:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787580068.641617:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea800/0xc86deac208337e79 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d211 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.641692:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feac00/0xc86deac208337e80 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.641713:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feac00/0xc86deac208337e80 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.641726:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feac00/0xc86deac208337e80 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.641742:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb800/0xc86deac208337e87 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.641749:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb800/0xc86deac208337e87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.641757:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb800/0xc86deac208337e87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.641902:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feaa00/0xc86deac208337e8e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.641911:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feaa00/0xc86deac208337e8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.641919:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feaa00/0xc86deac208337e8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787580068.641942:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1787580068.642057:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feac00/0xc86deac208337e80 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.642065:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feac00/0xc86deac208337e80 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.642072:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feac00/0xc86deac208337e80 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.642078:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae50feac00 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:0.0:1787580068.642082:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feac00/0xc86deac208337e80 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.642090:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feac00/0xc86deac208337e80 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.642104:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8fae5bb2f900) 00010000:00010000:0.0:1787580068.642108:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787580068.642113:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feac00/0xc86deac208337e80 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.642119:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feac00/0xc86deac208337e80 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.642132:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb800/0xc86deac208337e87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.642138:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb800/0xc86deac208337e87 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.642155:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb800/0xc86deac208337e87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.642169:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae50feb800 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:0.0:1787580068.642173:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb800/0xc86deac208337e87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.642179:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb800/0xc86deac208337e87 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.642186:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8fae56e35b00) 00010000:00010000:0.0:1787580068.642189:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787580068.642191:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb800/0xc86deac208337e87 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.642197:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb800/0xc86deac208337e87 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.642238:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea800/0xc86deac208337e79 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d211 expref: 50 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.642251:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feaa00/0xc86deac208337e8e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d211 expref: 49 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.642258:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8fae56e35f00) 00010000:00010000:0.0:1787580068.642260:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787580068.642263:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae50feaa00, rc 0) 00000100:00100000:0.0:1787580068.642349:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7efc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+49:10587:x1874413239716480:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 788us (5552us total) trans 4294967390 rc 0/0 00000100:00100000:0.0:1787580068.642366:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 102 00000100:00100000:1.0:1787580068.649007:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580068.649080:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239716608 00000100:00100000:2.0:1787580068.649094:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239716608 00000100:00100000:2.0:1787580068.649168:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 103 00000100:00100000:2.0:1787580068.649180:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5072a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+49:10587:x1874413239716608:12345-192.168.202.36@tcp:54:lfs.0 00010000:00010000:2.0:1787580068.649426:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9a00/0xc86deac208337e9c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580068.649445:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9a00/0xc86deac208337e9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580068.649457:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9a00/0xc86deac208337e9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580068.649484:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9a00/0xc86deac208337e9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580068.649491:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9a00/0xc86deac208337e9c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580068.649498:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9a00/0xc86deac208337e9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580068.649504:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db9a00 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:2.0:1787580068.649509:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9a00/0xc86deac208337e9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580068.649532:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9a00/0xc86deac208337e9c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580068.649547:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8fae56e35f00) 00010000:00010000:2.0:1787580068.649551:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787580068.649556:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9a00/0xc86deac208337e9c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580068.649563:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9a00/0xc86deac208337e9c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580068.650133:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5072a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+49:10587:x1874413239716608:12345-192.168.202.36@tcp:54:lfs.0 Request processed in 952us (1148us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580068.650142:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 103 00000100:00100000:3.0:1787580068.655666:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580068.655752:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239716864 00000100:00100000:2.0:1787580068.655761:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239716864 00000100:00100000:2.0:1787580068.655830:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 28 00000100:00100000:2.0:1787580068.655840:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7efcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+49:10587:x1874413239716864:12345-192.168.202.36@tcp:35:lfs.0 00000100:00100000:2.0:1787580068.656114:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7efcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+50:10587:x1874413239716864:12345-192.168.202.36@tcp:35:lfs.0 Request processed in 274us (456us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1787580068.656122:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 28 00000100:00100000:3.0:1787580068.741757:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580068.741970:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239717120 00000100:00100000:0.0:1787580068.741994:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239717120 00000100:00100000:0.0:1787580068.742057:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 104 00000100:00100000:0.0:1787580068.742068:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7efc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+50:10597:x1874413239717120:12345-192.168.202.36@tcp:101:bash.0 00010000:00010000:0.0:1787580068.742103:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787580068.742107:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787580068.742137:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea400/0xc86deac208337e1e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1f5 expref: 50 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.742157:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8fae5bb2f900) 00010000:00010000:0.0:1787580068.742162:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787580068.742175:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea800/0xc86deac208337ea3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d218 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.742276:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb800/0xc86deac208337eaa lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.742290:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feaa00/0xc86deac208337e8e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d211 expref: 50 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.742299:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb800/0xc86deac208337eaa lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.742331:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feaa00/0xc86deac208337e8e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d211 expref: 50 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.742344:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feaa00/0xc86deac208337e8e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d211 expref: 50 pid: 5854 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580068.742371:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d5ba680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5854:1874413262802816:192.168.202.36@tcp:104: 00000100:00100000:0.0:1787580068.742521:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae77a2f600 going to sleep for 11 seconds 00000100:00100000:3.0:1787580068.747570:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580068.747617:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d5ba680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5854:1874413262802816:192.168.202.36@tcp:104: 00000100:00100000:1.0:1787580068.747645:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239717248 00010000:00010000:0.0:1787580068.747648:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb800/0xc86deac208337eaa lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580068.747656:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239717248 00010000:00010000:1.0:1787580068.747702:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feaa00/0xc86deac208337e8e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d211 expref: 51 pid: 5854 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580068.747859:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 52 00000100:00100000:1.0:1787580068.747871:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7efcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+51:2361:x1874413239717248:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787580068.747887:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787580068.747895:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feaa00/0xc86deac208337e8e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d211 expref: 51 pid: 5854 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580068.747919:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feaa00/0xc86deac208337e8e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d211 expref: 51 pid: 5854 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580068.747942:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feaa00/0xc86deac208337e8e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d211 expref: 51 pid: 5854 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580068.747959:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8fae56e35f00) 00010000:00010000:1.0:1787580068.747964:0:5839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb800/0xc86deac208337eaa lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580068.747974:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb800/0xc86deac208337eaa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580068.748005:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb800/0xc86deac208337eaa lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580068.748047:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787580068.748106:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7efcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+50:2361:x1874413239717248:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 237us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580068.748114:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 52 00010000:00010000:2.0:1787580068.748173:0:5854:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb800/0xc86deac208337eaa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580068.748181:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb800/0xc86deac208337eaa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787580068.748212:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1787580068.748378:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea800/0xc86deac208337ea3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d218 expref: 51 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580068.748418:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb800/0xc86deac208337eaa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d218 expref: 50 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580068.748427:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8fae56e35f00) 00010000:00010000:2.0:1787580068.748430:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787580068.748432:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae50feb800, rc 0) 00000100:00100000:2.0:1787580068.748477:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7efc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+50:10597:x1874413239717120:12345-192.168.202.36@tcp:101:bash.0 Request processed in 6411us (6730us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1787580068.748484:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 104 00000100:00100000:3.0:1787580068.753192:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580068.753285:0:8897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239717504 00000100:00100000:1.0:1787580068.753296:0:8897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239717504 00000100:00100000:1.0:1787580068.753361:0:8897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 105 00000100:00100000:1.0:1787580068.753373:0:8897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae77a8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+50:10597:x1874413239717504:12345-192.168.202.36@tcp:36:bash.0 00010000:00010000:1.0:1787580068.753771:0:8897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660600/0xc86deac208337eb8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580068.753790:0:8897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660600/0xc86deac208337eb8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580068.753802:0:8897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660600/0xc86deac208337eb8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787580068.754000:0:8897:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:1.0:1787580068.754026:0:8897:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009a90c703 reply state 0000000081a658bc transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660600/0xc86deac208337eb8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580068.754034:0:8897:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787580068.754138:0:8897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae77a8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+53:10597:x1874413239717504:12345-192.168.202.36@tcp:36:bash.0 Request processed in 766us (955us total) trans 4294967394 rc 0/0 00000100:00100000:1.0:1787580068.754145:0:8897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 105 00000020:00080000:1.0:1787580068.754150:0:8897:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787580068.756993:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00010000:00010000:2.0:1787580068.757288:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660600/0xc86deac208337eb8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580068.757300:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660600/0xc86deac208337eb8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580068.757308:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660600/0xc86deac208337eb8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580068.757314:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae41660600 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:2.0:1787580068.757319:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660600/0xc86deac208337eb8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580068.757327:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660600/0xc86deac208337eb8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580068.757345:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8fae56e35f00) 00010000:00010000:2.0:1787580068.757348:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787580068.757369:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660600/0xc86deac208337eb8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580068.757376:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660600/0xc86deac208337eb8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580068.757919:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239717632 00000100:00100000:1.0:1787580068.757934:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239717632 00000100:00100000:1.0:1787580068.758012:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 106 00000100:00100000:1.0:1787580068.758023:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae504b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+52:10597:x1874413239717632:12345-192.168.202.36@tcp:101:bash.0 00010000:00010000:1.0:1787580068.758049:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787580068.758075:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660e00/0xc86deac208337ebf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d21f expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580068.758147:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660200/0xc86deac208337ec6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580068.758159:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb800/0xc86deac208337eaa lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d218 expref: 53 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580068.758175:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660200/0xc86deac208337ec6 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580068.758212:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb800/0xc86deac208337eaa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d218 expref: 53 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580068.758224:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb800/0xc86deac208337eaa lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d218 expref: 53 pid: 5854 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580068.758237:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae50729c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5853:1874413262802944:192.168.202.36@tcp:104: 00000100:00100000:1.0:1787580068.758323:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae49ef0240 going to sleep for 11 seconds 00000100:00100000:1.0:1787580068.765835:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae50729c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5853:1874413262802944:192.168.202.36@tcp:104: 00010000:00010000:1.0:1787580068.766132:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660200/0xc86deac208337ec6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580068.766522:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580068.766595:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239717760 00000100:00100000:1.0:1787580068.766603:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239717760 00010000:00010000:1.0:1787580068.766638:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb800/0xc86deac208337eaa lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d218 expref: 54 pid: 5854 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580068.766720:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 53 00000100:00100000:1.0:1787580068.766730:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae504b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+54:2360:x1874413239717760:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787580068.766744:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787580068.766751:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb800/0xc86deac208337eaa lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d218 expref: 54 pid: 5854 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580068.766764:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb800/0xc86deac208337eaa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d218 expref: 54 pid: 5854 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580068.766786:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb800/0xc86deac208337eaa lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d218 expref: 54 pid: 5854 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580068.766803:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8fae56e35f00) 00010000:00010000:1.0:1787580068.766814:0:5840:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660200/0xc86deac208337ec6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580068.766823:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660200/0xc86deac208337ec6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580068.766830:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660200/0xc86deac208337ec6 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580068.766864:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787580068.766931:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae504b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+53:2360:x1874413239717760:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 201us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580068.766938:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 53 00010000:00010000:3.0:1787580068.766990:0:5853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660200/0xc86deac208337ec6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580068.766998:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660200/0xc86deac208337ec6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787580068.767057:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1787580068.767070:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787580068.767093:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660200/0xc86deac208337ec6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580068.767127:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660e00/0xc86deac208337ebf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d21f expref: 53 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580068.767141:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660200/0xc86deac208337ec6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d21f expref: 52 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580068.767148:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8fae56e35f00) 00010000:00010000:3.0:1787580068.767150:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787580068.767153:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae41660200, rc 0) 00000100:00100000:3.0:1787580068.767205:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae504b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+52:10597:x1874413239717632:12345-192.168.202.36@tcp:101:bash.0 Request processed in 9183us (10229us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580068.767211:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 106 00000100:00100000:3.0:1787580068.783728:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580068.784852:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239718016 00000100:00100000:2.0:1787580068.785004:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239718016 00000100:00100000:2.0:1787580068.785079:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 29 00000100:00100000:2.0:1787580068.785091:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d685500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+52:10597:x1874413239718016:12345-192.168.202.36@tcp:35:bash.0 00000100:00100000:2.0:1787580068.787479:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d685500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+53:10597:x1874413239718016:12345-192.168.202.36@tcp:35:bash.0 Request processed in 2378us (3748us total) trans 4294967395 rc 0/0 00000100:00100000:2.0:1787580068.787492:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 29 00000100:00100000:2.0:1787580068.849634:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580068.850187:0:8897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239718144 00000100:00100000:1.0:1787580068.850196:0:8897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239718144 00000100:00100000:1.0:1787580068.850250:0:8897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 107 00000100:00100000:1.0:1787580068.850260:0:8897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5f812a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+53:10603:x1874413239718144:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:1.0:1787580068.850283:0:8897:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787580068.850304:0:8897:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661200/0xc86deac208337ecd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d226 expref: -99 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580068.850362:0:8897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661600/0xc86deac208337ed4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580068.850377:0:8897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661600/0xc86deac208337ed4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580068.850414:0:8897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661600/0xc86deac208337ed4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787580068.850476:0:8897:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:1.0:1787580068.850480:0:8897:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787580068.850501:0:8897:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661600/0xc86deac208337ed4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580068.850523:0:8897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661200/0xc86deac208337ecd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d226 expref: 55 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580068.850541:0:8897:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661600/0xc86deac208337ed4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d226 expref: 54 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580068.850570:0:8897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8fae5bb2f900) 00010000:00010000:1.0:1787580068.850573:0:8897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787580068.850577:0:8897:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae41661600, rc 0) 00000100:00100000:1.0:1787580068.850678:0:8897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5f812a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+54:10603:x1874413239718144:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 418us (1053us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580068.850686:0:8897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 107 00000100:00100000:3.0:1787580068.861045:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580068.861204:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239718272 00000100:00100000:2.0:1787580068.861214:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239718272 00000100:00100000:2.0:1787580068.861280:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 108 00000100:00100000:2.0:1787580068.861296:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d687b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+54:10603:x1874413239718272:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:2.0:1787580068.861332:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787580068.861353:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8a00/0xc86deac208337edb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d22d expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580068.861444:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8000/0xc86deac208337ee2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580068.861460:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8000/0xc86deac208337ee2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580068.861470:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8000/0xc86deac208337ee2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580068.861500:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9400/0xc86deac208337ee9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580068.861508:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9400/0xc86deac208337ee9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580068.861516:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9400/0xc86deac208337ee9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580068.861631:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9a00/0xc86deac208337ef0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580068.861641:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9a00/0xc86deac208337ef0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580068.861647:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9a00/0xc86deac208337ef0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787580068.861682:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1787580068.861686:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787580068.861706:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9a00/0xc86deac208337ef0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580068.861718:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9a00/0xc86deac208337ef0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580068.861727:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8000/0xc86deac208337ee2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580068.861733:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8000/0xc86deac208337ee2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580068.861750:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8000/0xc86deac208337ee2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580068.861756:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db8000 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:2.0:1787580068.861761:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8000/0xc86deac208337ee2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580068.861768:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8000/0xc86deac208337ee2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580068.861783:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8fae5bb2f900) 00010000:00010000:2.0:1787580068.861786:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787580068.861791:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8000/0xc86deac208337ee2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580068.861797:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8000/0xc86deac208337ee2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580068.861812:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9400/0xc86deac208337ee9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580068.861817:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9400/0xc86deac208337ee9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580068.861823:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9400/0xc86deac208337ee9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580068.861828:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db9400 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:2.0:1787580068.861831:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9400/0xc86deac208337ee9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580068.861846:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9400/0xc86deac208337ee9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580068.861855:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8fae4c7d9f00) 00010000:00010000:2.0:1787580068.861857:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787580068.861859:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9400/0xc86deac208337ee9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580068.861865:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9400/0xc86deac208337ee9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580068.861895:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8a00/0xc86deac208337edb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d22d expref: 56 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580068.861909:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9a00/0xc86deac208337ef0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d22d expref: 55 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580068.861916:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8fae56e35f00) 00010000:00010000:2.0:1787580068.861918:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787580068.861921:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae48db9a00, rc 0) 00000100:00100000:2.0:1787580068.862005:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d687b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+55:10603:x1874413239718272:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 711us (969us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580068.862013:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 108 00000100:00100000:3.0:1787580068.868622:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580068.868722:0:8897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239718528 00000100:00100000:1.0:1787580068.868732:0:8897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239718528 00000100:00100000:1.0:1787580068.868789:0:8897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 109 00000100:00100000:1.0:1787580068.868799:0:8897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d684a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+55:10603:x1874413239718528:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:1.0:1787580068.868825:0:8897:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787580068.868845:0:8897:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661200/0xc86deac208337ef7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d234 expref: -99 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580068.868970:0:8897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660a00/0xc86deac208337efe lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580068.868993:0:8897:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660200/0xc86deac208337ec6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d21f expref: 56 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580068.869002:0:8897:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9a00/0xc86deac208337ef0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d22d expref: 56 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580068.869011:0:8897:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660a00/0xc86deac208337efe lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580068.869046:0:8897:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9a00/0xc86deac208337ef0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d22d expref: 56 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580068.869074:0:8897:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9a00/0xc86deac208337ef0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d22d expref: 56 pid: 5854 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580068.869090:0:8897:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae50729c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8897:1874413262803072:192.168.202.36@tcp:104: 00010000:00010000:1.0:1787580068.869183:0:8897:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660200/0xc86deac208337ec6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d21f expref: 56 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580068.869193:0:8897:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660200/0xc86deac208337ec6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d21f expref: 56 pid: 5853 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580068.869202:0:8897:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae50729f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8897:1874413262803200:192.168.202.36@tcp:104: 00000100:00100000:1.0:1787580068.869225:0:8897:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae49ef0840 going to sleep for 11 seconds 00000100:00100000:0.0:1787580068.875575:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580068.875915:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239718656 00000100:00100000:3.0:1787580068.875937:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239718656 00010000:00010000:3.0:1787580068.875992:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660200/0xc86deac208337ec6 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d21f expref: 57 pid: 5853 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580068.876038:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 54 00000100:00100000:3.0:1787580068.876048:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d5ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+57:2360:x1874413239718656:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787580068.876493:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787580068.876502:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660200/0xc86deac208337ec6 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d21f expref: 57 pid: 5853 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580068.876516:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660200/0xc86deac208337ec6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d21f expref: 57 pid: 5853 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580068.876541:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8fae56e35f00) 00010000:00010000:3.0:1787580068.876547:0:5839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660a00/0xc86deac208337efe lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580068.876557:0:5839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660a00/0xc86deac208337efe lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580068.876563:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787580068.876730:0:8897:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae50729c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8897:1874413262803072:192.168.202.36@tcp:104: 00010000:00010000:1.0:1787580068.876743:0:8897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660200/0xc86deac208337ec6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d21f expref: 57 pid: 5853 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580068.876760:0:8897:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae50729f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8897:1874413262803200:192.168.202.36@tcp:104: 00010000:00010000:1.0:1787580068.876782:0:8897:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660a00/0xc86deac208337efe lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580068.880691:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d5ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+56:2360:x1874413239718656:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 4631us (5113us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580068.880706:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 54 00000100:00100000:2.0:1787580068.898198:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580068.898672:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580068.903006:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239718784 00000100:00100000:1.0:1787580068.903025:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239718784 00010000:00010000:1.0:1787580068.903152:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9a00/0xc86deac208337ef0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d22d expref: 56 pid: 5854 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580068.903318:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239718912 00000100:00100000:0.0:1787580068.903323:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239718912 00010000:00010000:0.0:1787580068.903343:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9a00/0xc86deac208337ef0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d22d expref: 57 pid: 5854 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580068.903374:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 55 00000100:00100000:0.0:1787580068.903397:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48d87c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+57:2361:x1874413239718784:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787580068.903413:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787580068.903420:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9a00/0xc86deac208337ef0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d22d expref: 57 pid: 5854 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.903433:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9a00/0xc86deac208337ef0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d22d expref: 57 pid: 5854 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.903456:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9a00/0xc86deac208337ef0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d22d expref: 57 pid: 5854 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.903472:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8fae56e35f00) 00010000:00010000:0.0:1787580068.903485:0:5838:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660a00/0xc86deac208337efe lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.903494:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660a00/0xc86deac208337efe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.903501:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660a00/0xc86deac208337efe lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.903529:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787580068.903597:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48d87c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+56:2361:x1874413239718784:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 214us (11806us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580068.903605:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 55 00000100:00100000:0.0:1787580068.903651:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 56 00000100:00100000:0.0:1787580068.903657:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5f811500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+55:2361:x1874413239718912:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787580068.903665:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787580068.903668:0:5838:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie c86deac208337ef0) 00010000:00010000:0.0:1787580068.903669:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787580068.903685:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5f811500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+55:2361:x1874413239718912:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 29us (5017us total) trans 0 rc 116/116 00000100:00100000:0.0:1787580068.903691:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 56 00010000:00010000:0.0:1787580068.903836:0:8897:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660a00/0xc86deac208337efe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.903844:0:8897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660a00/0xc86deac208337efe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787580068.903862:0:8897:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1787580068.904761:0:8897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661200/0xc86deac208337ef7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d234 expref: 56 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.904799:0:8897:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660a00/0xc86deac208337efe lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d234 expref: 55 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580068.904812:0:8897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8fae56e35f00) 00010000:00010000:0.0:1787580068.904815:0:8897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787580068.904818:0:8897:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae41660a00, rc 0) 00000100:00100000:0.0:1787580068.904860:0:8897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d684a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+55:10603:x1874413239718528:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 36062us (36249us total) trans 4294967396 rc 0/0 00000100:00100000:0.0:1787580068.904870:0:8897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 109 00000100:00100000:2.0:1787580068.911099:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580068.911198:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239719168 00000100:00100000:3.0:1787580068.911223:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239719168 00000100:00100000:3.0:1787580068.911292:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 7 00000100:00100000:3.0:1787580068.911303:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5f6fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+55:10603:x1874413239719168:12345-192.168.202.36@tcp:103:lfs.0 00010000:00010000:3.0:1787580068.911320:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787580068.911348:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac208337e5d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d20a expref: 55 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580068.911365:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8fae56e35f00) 00010000:00010000:3.0:1787580068.911370:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787580068.911457:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5f6fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+54:10603:x1874413239719168:12345-192.168.202.36@tcp:103:lfs.0 Request processed in 156us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580068.911465:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 7 00000100:00100000:0.0:1787580068.917269:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580068.917425:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239719296 00000100:00100000:2.0:1787580068.917435:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239719296 00000100:00100000:2.0:1787580068.917505:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 110 00000100:00100000:2.0:1787580068.917516:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d5ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+54:10603:x1874413239719296:12345-192.168.202.36@tcp:58:lfs.0 00010000:00010000:2.0:1787580068.917635:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9400/0xc86deac208337f0c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580068.917653:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9400/0xc86deac208337f0c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580068.917666:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9400/0xc86deac208337f0c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787580068.917857:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1787580068.918159:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d5ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+54:10603:x1874413239719296:12345-192.168.202.36@tcp:58:lfs.0 Request processed in 643us (899us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580068.918168:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 110 00000100:00100000:1.0:1787580068.926855:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580068.927041:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239719424 00000100:00100000:2.0:1787580068.927050:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239719424 00000100:00100000:2.0:1787580068.927100:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 111 00000100:00100000:2.0:1787580068.927108:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae50729f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+54:10603:x1874413239719424:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:2.0:1787580068.927126:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787580068.927146:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8000/0xc86deac208337f13 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d23b expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580068.927209:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9400/0xc86deac208337f0c lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580068.927228:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8000/0xc86deac208337f13 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d23b expref: 55 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580068.927268:0:5852:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9400/0xc86deac208337f0c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580068.927278:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8000/0xc86deac208337f13 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d23b expref: 55 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580068.927291:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8fae56e35f00) 00010000:00010000:2.0:1787580068.927293:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787580068.927296:0:5852:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8000/0xc86deac208337f13 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d23b expref: 55 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580068.927302:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae48db8000, rc 0) 00000100:00100000:2.0:1787580068.927443:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae50729f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+55:10603:x1874413239719424:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 336us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580068.927448:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 111 00000100:00100000:2.0:1787580068.980218:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787580068.980243:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae50729c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874413262803328:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787580068.980330:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787580068.980490:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262803328 00000100:00100000:1.0:1787580068.980500:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262803328 00000100:00100000:1.0:1787580068.980563:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787580068.980575:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5f6ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1874413262803328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787580068.980601:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787580068.980663:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5f6ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1874413262803328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580068.980670:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787580068.981154:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae50729c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874413262803328:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787580069.365686:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787580069.431108:0:11700:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787580069.431119:0:11700:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787580069.431175:0:11700:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:3.0:1787580069.431184:0:11700:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787580069.431428:0:11700:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d687800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11700:1874413262803456:192.168.202.36@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787580069.431544:0:11700:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae51e92300 going to sleep for 11 seconds 00000100:00100000:3.0:1787580069.435356:0:11700:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d687800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11700:1874413262803456:192.168.202.36@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787580069.438373:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580069.438592:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239719552 00000100:00100000:1.0:1787580069.438602:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239719552 00000100:00100000:1.0:1787580069.438685:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 112 00000100:00100000:1.0:1787580069.438697:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d687800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+55:10606:x1874413239719552:12345-192.168.202.36@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787580069.438754:0:5853:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787580069.438970:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d687800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+55:10606:x1874413239719552:12345-192.168.202.36@tcp:53:lhsmtool_posix.0 Request processed in 274us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580069.438986:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 112 00000100:00080000:2.0:1787580069.440364:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787580069.445171:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580069.445324:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239719680 00000100:00100000:2.0:1787580069.445335:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239719680 00000100:00100000:2.0:1787580069.445421:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 113 00000100:00100000:2.0:1787580069.445432:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5072aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+55:10606:x1874413239719680:12345-192.168.202.36@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787580069.445510:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208337f1a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580069.445539:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208337f1a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580069.445550:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208337f1a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580069.445607:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208337f21 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580069.445614:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208337f21 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580069.445621:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208337f21 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580069.445640:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8600/0xc86deac208337f28 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580069.445647:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8600/0xc86deac208337f28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580069.445653:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8600/0xc86deac208337f28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787580069.445690:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1787580069.445694:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787580069.445705:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8600/0xc86deac208337f28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580069.445715:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208337f1a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580069.445731:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208337f1a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580069.445738:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208337f1a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580069.445743:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db9000 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:2.0:1787580069.445747:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208337f1a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580069.445754:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208337f1a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580069.445765:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8fae5bb2f000) 00010000:00010000:2.0:1787580069.445768:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787580069.445772:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208337f1a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580069.445777:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208337f1a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580069.445791:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208337f21 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580069.445796:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208337f21 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580069.445802:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208337f21 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580069.445807:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db9c00 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:2.0:1787580069.445815:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208337f21 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580069.445821:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208337f21 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580069.445828:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff8fae4c7d9f00) 00010000:00010000:2.0:1787580069.445830:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787580069.445833:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208337f21 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580069.445838:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208337f21 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580069.445851:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8600/0xc86deac208337f28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580069.445857:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8600/0xc86deac208337f28 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580069.445862:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8600/0xc86deac208337f28 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580069.445866:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db8600 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:2.0:1787580069.445869:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8600/0xc86deac208337f28 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580069.445874:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8600/0xc86deac208337f28 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580069.445879:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8fae56e35f00) 00010000:00010000:2.0:1787580069.445882:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787580069.445888:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8600/0xc86deac208337f28 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580069.445893:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8600/0xc86deac208337f28 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580069.446029:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5072aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+55:10606:x1874413239719680:12345-192.168.202.36@tcp:34:lhsmtool_posix.0 Request processed in 598us (866us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580069.446038:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 113 00000100:00100000:2.0:1787580069.452551:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580069.453689:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239719936 00000100:00100000:0.0:1787580069.453703:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239719936 00000100:00100000:0.0:1787580069.453775:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 114 00000100:00100000:0.0:1787580069.453786:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74ed1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+55:10606:x1874413239719936:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787580069.453810:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787580069.453832:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feac00/0xc86deac208337f2f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d242 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.453942:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea000/0xc86deac208337f36 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.453958:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea000/0xc86deac208337f36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.453970:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea000/0xc86deac208337f36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787580069.454014:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1787580069.454146:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea000/0xc86deac208337f36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.454155:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea000/0xc86deac208337f36 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.454162:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea000/0xc86deac208337f36 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.454169:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae50fea000 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:0.0:1787580069.454174:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea000/0xc86deac208337f36 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.454182:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea000/0xc86deac208337f36 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.454196:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8fae56e35f00) 00010000:00010000:0.0:1787580069.454199:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787580069.454204:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea000/0xc86deac208337f36 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.454210:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea000/0xc86deac208337f36 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.454258:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feac00/0xc86deac208337f2f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d242 expref: 57 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.454269:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8fae5bb2f000) 00010000:00010000:0.0:1787580069.454272:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787580069.454283:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feac00/0xc86deac208337f2f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d242 expref: 57 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.454293:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae50feac00, rc 0) 00000100:00100000:0.0:1787580069.454375:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74ed1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+56:10606:x1874413239719936:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 Request processed in 589us (1835us total) trans 4294967397 rc 301/301 00000100:00100000:0.0:1787580069.454422:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 114 00000100:00100000:3.0:1787580069.457219:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580069.457350:0:8897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239720064 00000100:00100000:0.0:1787580069.457360:0:8897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239720064 00000100:00100000:0.0:1787580069.457472:0:8897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 115 00000100:00100000:0.0:1787580069.457483:0:8897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d687100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+56:10606:x1874413239720064:12345-192.168.202.36@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787580069.457520:0:8897:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787580069.457626:0:8897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d687100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+56:10606:x1874413239720064:12345-192.168.202.36@tcp:53:lhsmtool_posix.0 Request processed in 143us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580069.457634:0:8897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 115 00000100:00100000:2.0:1787580069.480558:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580069.480827:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239720320 00000100:00100000:0.0:1787580069.480839:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239720320 00000100:00100000:0.0:1787580069.480986:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 116 00000100:00100000:0.0:1787580069.480998:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51cac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+56:10606:x1874413239720320:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787580069.481020:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787580069.481024:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787580069.481115:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661600/0xc86deac208337ed4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d226 expref: 56 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.481137:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8fae5bb2f900) 00010000:00010000:0.0:1787580069.481141:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787580069.481157:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feac00/0xc86deac208337f44 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d249 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787580069.481829:0:5854:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:0.0:1787580069.483416:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea000/0xc86deac208337f4b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.483438:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea000/0xc86deac208337f4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.483451:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea000/0xc86deac208337f4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.484225:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feac00/0xc86deac208337f44 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d249 expref: 58 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.484250:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea000/0xc86deac208337f4b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d249 expref: 57 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.484260:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8fae56e35500) 00010000:00010000:0.0:1787580069.484263:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787580069.484267:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae50fea000, rc 0) 00000100:00100000:0.0:1787580069.486481:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51cac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+57:10606:x1874413239720320:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 Request processed in 5472us (5920us total) trans 4294967398 rc 0/0 00000100:00100000:0.0:1787580069.486494:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 116 00000100:00100000:3.0:1787580069.491524:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580069.491630:0:8897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239720576 00000100:00100000:0.0:1787580069.491641:0:8897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239720576 00000100:00100000:0.0:1787580069.492078:0:8897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 117 00000100:00100000:0.0:1787580069.492091:0:8897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d685180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+57:10606:x1874413239720576:12345-192.168.202.36@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787580069.492179:0:8897:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787580069.492226:0:8897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea000/0xc86deac208337f4b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d249 expref: 57 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.492244:0:8897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8fae56e35500) 00010000:00010000:0.0:1787580069.492255:0:8897:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787580069.492350:0:8897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feae00/0xc86deac208337f59 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.492366:0:8897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feae00/0xc86deac208337f59 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.492377:0:8897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feae00/0xc86deac208337f59 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.492468:0:8897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50febe00/0xc86deac208337f60 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xf2b33665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.492478:0:8897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50febe00/0xc86deac208337f60 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xf2b33665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.492485:0:8897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50febe00/0xc86deac208337f60 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xf2b33665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.492579:0:8897:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feae00/0xc86deac208337f59 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.492587:0:8897:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feae00/0xc86deac208337f59 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.492594:0:8897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feae00/0xc86deac208337f59 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.492600:0:8897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae50feae00 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:0.0:1787580069.492611:0:8897:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feae00/0xc86deac208337f59 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.492619:0:8897:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feae00/0xc86deac208337f59 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.492627:0:8897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8fae5bb2f900) 00010000:00010000:0.0:1787580069.492630:0:8897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787580069.492633:0:8897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feae00/0xc86deac208337f59 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.492639:0:8897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feae00/0xc86deac208337f59 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.492650:0:8897:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50febe00/0xc86deac208337f60 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xf2b33665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.492656:0:8897:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50febe00/0xc86deac208337f60 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf2b33665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.492661:0:8897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50febe00/0xc86deac208337f60 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf2b33665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.492666:0:8897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae50febe00 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:0.0:1787580069.492669:0:8897:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50febe00/0xc86deac208337f60 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf2b33665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.492675:0:8897:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50febe00/0xc86deac208337f60 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf2b33665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.492693:0:8897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xf2b33665 (ffff8fae56e35600) 00010000:00010000:0.0:1787580069.492695:0:8897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787580069.492707:0:8897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50febe00/0xc86deac208337f60 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xf2b33665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.492713:0:8897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50febe00/0xc86deac208337f60 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xf2b33665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580069.492872:0:8897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d685180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+56:10606:x1874413239720576:12345-192.168.202.36@tcp:36:lhsmtool_posix.0 Request processed in 782us (1358us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787580069.492880:0:8897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 117 00000100:00100000:2.0:1787580069.493252:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae48c91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874413262803712:0@lo:400:kworker.0 00000100:00100000:2.0:1787580069.493301:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580069.496562:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262803712 00000100:00100000:2.0:1787580069.496566:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7ec51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262804224:0@lo:400:kworker.0 00000100:00100000:3.0:1787580069.496575:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262803712 00000100:00100000:2.0:1787580069.496632:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580069.496653:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580069.496668:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787580069.496680:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae48c90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874413262803840:0@lo:400:kworker.0 00000100:00100000:2.0:1787580069.496705:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787580069.496734:0:10268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262804224 00000100:00100000:2.0:1787580069.496738:0:10268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262804224 00000100:00100000:2.0:1787580069.496795:0:10268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787580069.496805:0:10268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7ec52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3316:x1874413262804224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787580069.496815:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239720704 00000100:00100000:1.0:1787580069.496819:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239720704 00000100:00100000:2.0:1787580069.496860:0:10268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7ec52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3316:x1874413262804224:12345-0@lo:400:kworker.0 Request processed in 56us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580069.496864:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262803840 00000100:00100000:1.0:1787580069.496867:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262803840 00000100:00100000:2.0:1787580069.496870:0:10268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787580069.496880:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787580069.496886:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7ec52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874413262803840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787580069.496940:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7ec52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874413262803840:12345-0@lo:400:kworker.0 Request processed in 53us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580069.496946:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787580069.496961:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 118 00000100:00100000:1.0:1787580069.496968:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d686d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+56:10606:x1874413239720704:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787580069.497167:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787580069.497204:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660200/0xc86deac208337f67 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d250 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580069.497242:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661200/0xc86deac208337f6e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580069.497255:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661200/0xc86deac208337f6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580069.497266:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661200/0xc86deac208337f6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580069.497370:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660200/0xc86deac208337f67 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d250 expref: 58 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580069.497416:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661200/0xc86deac208337f6e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d250 expref: 57 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580069.497426:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8fae5bb2fb00) 00010000:00010000:1.0:1787580069.497429:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787580069.497433:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae41661200, rc 0) 00000100:00100000:1.0:1787580069.497478:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d686d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+57:10606:x1874413239720704:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 Request processed in 511us (828us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580069.497491:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 118 00000100:00100000:1.0:1787580069.497538:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787580069.497545:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7ec51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874413262803712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787580069.497580:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7ec51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874413262803712:12345-0@lo:400:kworker.0 Request processed in 36us (4279us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580069.497586:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787580069.497653:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae48c90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3315:1874413262803584:0@lo:400:kworker.0 00000100:00100000:1.0:1787580069.497702:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787580069.497735:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7ec52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1874413262804096:0@lo:400:kworker.0 00000100:00100000:1.0:1787580069.497761:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787580069.497789:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262804096 00000100:00100000:2.0:1787580069.498022:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7f35dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874413262803968:0@lo:400:kworker.0 00000100:00100000:2.0:1787580069.498125:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787580069.498170:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262804096 00000100:00100000:2.0:1787580069.498171:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262803584 00000100:00100000:2.0:1787580069.498177:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262803584 00000100:00100000:2.0:1787580069.498216:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1787580069.498224:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787580069.498226:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:3315:x1874413262803584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787580069.498236:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5072a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874413262804096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787580069.498272:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:3315:x1874413262803584:12345-0@lo:400:kworker.0 Request processed in 49us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580069.498279:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00080000:3.0:1787580069.498414:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787580069.498420:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787580069.500570:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae48c90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874413262803840:0@lo:400:kworker.0 00000100:00100000:3.0:1787580069.500590:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae48c91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874413262803712:0@lo:400:kworker.0 00000100:00100000:3.0:1787580069.500601:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7ec51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262804224:0@lo:400:kworker.0 00000100:00100000:0.0:1787580069.504009:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae48c90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3315:1874413262803584:0@lo:400:kworker.0 00000100:00100000:0.0:1787580069.504033:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7ec52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1874413262804096:0@lo:400:kworker.0 00000100:00100000:0.0:1787580069.504078:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262803968 00000100:00100000:0.0:1787580069.504084:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262803968 00000100:00100000:0.0:1787580069.504136:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787580069.504146:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7ec50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3314:x1874413262803968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787580069.504359:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7ec50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3314:x1874413262803968:12345-0@lo:400:kworker.0 Request processed in 213us (6233us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580069.504367:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787580069.504494:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5072a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874413262804096:12345-0@lo:400:kworker.0 Request processed in 5437us (5906us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580069.504507:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787580069.509429:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580069.509466:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239720960 00000100:00100000:0.0:1787580069.509479:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239720960 00000100:00100000:0.0:1787580069.509555:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 119 00000100:00100000:0.0:1787580069.509567:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae50728700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+57:10606:x1874413239720960:12345-192.168.202.36@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787580069.509686:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea000/0xc86deac208337f75 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.509706:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea000/0xc86deac208337f75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.509736:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea000/0xc86deac208337f75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787580069.510458:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:0.0:1787580069.510472:0:5854:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 417266088204ns, next at 418266085269ns, rc = 0 00000004:00010000:0.0:1787580069.510570:0:5854:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000072de6f41 reply state 00000000c214f103 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea000/0xc86deac208337f75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580069.510580:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787580069.512018:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae50728700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+59:10606:x1874413239720960:12345-192.168.202.36@tcp:36:lhsmtool_posix.0 Request processed in 2446us (2638us total) trans 4294967399 rc 0/0 00000100:00100000:0.0:1787580069.512029:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 119 00000100:00100000:2.0:1787580069.515497:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7f35dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874413262803968:0@lo:400:kworker.0 00000100:00100000:3.0:1787580069.516568:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00010000:00010000:0.0:1787580069.517324:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea000/0xc86deac208337f75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.517338:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea000/0xc86deac208337f75 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.517347:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea000/0xc86deac208337f75 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.517354:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae50fea000 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:0.0:1787580069.517359:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea000/0xc86deac208337f75 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.517367:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea000/0xc86deac208337f75 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.517423:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8fae5bb2fb00) 00010000:00010000:0.0:1787580069.517427:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787580069.517447:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea000/0xc86deac208337f75 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.517455:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea000/0xc86deac208337f75 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580069.518761:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239721088 00000100:00100000:1.0:1787580069.518776:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239721088 00000100:00100000:1.0:1787580069.518850:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 120 00000100:00100000:1.0:1787580069.518857:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d686680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+58:10606:x1874413239721088:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787580069.518880:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787580069.518897:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660200/0xc86deac208337f7c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d257 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580069.518962:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660200/0xc86deac208337f7c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d257 expref: 59 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580069.518982:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660200/0xc86deac208337f7c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d257 expref: 59 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580069.519004:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8fae5bb2fb00) 00010000:00010000:1.0:1787580069.519007:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787580069.519011:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae41660200, rc 0) 00000100:00100000:1.0:1787580069.519090:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d686680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+59:10606:x1874413239721088:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 Request processed in 232us (2526us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580069.519098:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 120 00000100:00100000:3.0:1787580069.521772:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580069.521905:0:10268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239721216 00000100:00100000:2.0:1787580069.521915:0:10268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239721216 00000100:00080000:3.0:1787580069.521987:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787580069.522025:0:10268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 37 00000100:00100000:2.0:1787580069.522036:0:10268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5f6a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+8:2360:x1874413239721216:12345-192.168.202.36@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1787580069.522495:0:10268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5f6a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+9:2360:x1874413239721216:12345-192.168.202.36@tcp:2:lhsmtool_posix.0 Request processed in 458us (733us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1787580069.522505:0:10268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 37 00000100:00100000:3.0:1787580069.524645:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580069.526331:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239721472 00000100:00100000:1.0:1787580069.526348:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239721472 00000100:00100000:1.0:1787580069.526479:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 30 00000100:00100000:1.0:1787580069.526491:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d685c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+59:10606:x1874413239721472:12345-192.168.202.36@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787580069.526722:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d685c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+60:10606:x1874413239721472:12345-192.168.202.36@tcp:35:lhsmtool_posix.0 Request processed in 233us (2086us total) trans 4294967400 rc 0/0 00000100:00100000:1.0:1787580069.526728:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 30 00000100:00100000:3.0:1787580069.529193:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580069.529353:0:8897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239721728 00000100:00100000:1.0:1787580069.529363:0:8897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239721728 00000100:00100000:1.0:1787580069.529447:0:8897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 121 00000100:00100000:1.0:1787580069.529458:0:8897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d685f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+60:10606:x1874413239721728:12345-192.168.202.36@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787580069.529580:0:8897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d685f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+60:10606:x1874413239721728:12345-192.168.202.36@tcp:57:lhsmtool_posix.0 Request processed in 123us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580069.529599:0:8897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 121 00000100:00100000:3.0:1787580069.532813:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580069.533055:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239721856 00000100:00100000:1.0:1787580069.533065:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239721856 00000100:00100000:1.0:1787580069.533124:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 122 00000100:00100000:1.0:1787580069.533135:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d686a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+60:10606:x1874413239721856:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787580069.533155:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787580069.533176:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660e00/0xc86deac208337f83 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d25e expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580069.533257:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660600/0xc86deac208337f8a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580069.533271:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660600/0xc86deac208337f8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580069.533283:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660600/0xc86deac208337f8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787580069.533322:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787580069.533340:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660600/0xc86deac208337f8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580069.533363:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660e00/0xc86deac208337f83 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d25e expref: 62 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580069.533435:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660600/0xc86deac208337f8a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d25e expref: 61 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580069.533445:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8fae5bb2fb00) 00010000:00010000:1.0:1787580069.533462:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787580069.533466:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae41660600, rc 0) 00000100:00100000:1.0:1787580069.533522:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d686a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+61:10606:x1874413239721856:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 Request processed in 389us (729us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580069.533528:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 122 00000100:00100000:3.0:1787580069.537027:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580069.537172:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239721984 00000100:00100000:0.0:1787580069.537182:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239721984 00000100:00100000:0.0:1787580069.537253:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 38 00000100:00100000:0.0:1787580069.537266:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d686300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+9:2358:x1874413239721984:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787580069.537285:0:6707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787580069.537308:0:6707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cbd83212/0xc86deac208337f91 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d265 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787580069.537337:0:6707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8c4ea5, blocks: 0x1 00010000:00010000:0.0:1787580069.537360:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=417s v=(0 0) 00010000:00010000:0.0:1787580069.537365:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787580069.537376:0:6707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cbd83212/0xc86deac208337f91 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d265 expref: 10 pid: 6707 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.537442:0:6707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cbd83212/0xc86deac208337f91 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d265 expref: 10 pid: 6707 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.537455:0:6707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae50febe00, rc 0) 00000100:00100000:0.0:1787580069.537515:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d686300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+10:2358:x1874413239721984:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 Request processed in 252us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580069.537522:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 38 00000100:00100000:0.0:1787580069.559557:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580069.559686:0:8897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239722240 00000100:00100000:1.0:1787580069.559698:0:8897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239722240 00000100:00100000:1.0:1787580069.559768:0:8897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 123 00000100:00100000:1.0:1787580069.559781:0:8897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d5b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+61:10606:x1874413239722240:12345-192.168.202.36@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787580069.559925:0:8897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d5b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+61:10606:x1874413239722240:12345-192.168.202.36@tcp:57:lhsmtool_posix.0 Request processed in 147us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580069.559932:0:8897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 123 00000100:00100000:1.0:1787580069.565996:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580069.566094:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239722368 00000100:00100000:0.0:1787580069.566105:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239722368 00000100:00100000:0.0:1787580069.566167:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 39 00000100:00100000:0.0:1787580069.566179:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae50728e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+10:10606:x1874413239722368:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787580069.566197:0:6708:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787580069.566216:0:6708:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c3e8c7a/0xc86deac208337f98 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d26c expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.566247:0:6708:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cbd83212/0xc86deac208337f91 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d265 expref: 11 pid: 6707 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.566256:0:6708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787580069.566260:0:6708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787580069.566264:0:6708:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c3e8c7a/0xc86deac208337f98 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d26c expref: 11 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.566300:0:6708:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cbd83212/0xc86deac208337f91 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d265 expref: 11 pid: 6707 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.566314:0:6708:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cbd83212/0xc86deac208337f91 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d265 expref: 11 pid: 6707 timeout: 517 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580069.566328:0:6708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d5b9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6708:1874413262804352:192.168.202.36@tcp:104: 00000100:00100000:0.0:1787580069.566888:0:6708:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae77a2fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1787580069.572506:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580069.572619:0:6708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d5b9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6708:1874413262804352:192.168.202.36@tcp:104: 00010000:00010000:0.0:1787580069.572654:0:6708:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002c3e8c7a/0xc86deac208337f98 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d26c expref: 11 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.572691:0:6708:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae50feae00, rc 0) 00000100:00100000:0.0:1787580069.572760:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae50728e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+11:10606:x1874413239722368:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 Request processed in 6583us (6784us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580069.572768:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 39 00000100:00100000:3.0:1787580069.573431:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239722496 00000100:00100000:3.0:1787580069.573440:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239722496 00010000:00010000:3.0:1787580069.573476:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cbd83212/0xc86deac208337f91 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d265 expref: 11 pid: 6707 timeout: 517 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580069.573518:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 57 00000100:00100000:3.0:1787580069.573528:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae50728000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+11:2361:x1874413239722496:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787580069.573542:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787580069.573566:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cbd83212/0xc86deac208337f91 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d265 expref: 11 pid: 6707 timeout: 517 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580069.573579:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cbd83212/0xc86deac208337f91 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d265 expref: 11 pid: 6707 timeout: 517 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580069.573602:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cbd83212/0xc86deac208337f91 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d265 expref: 11 pid: 6707 timeout: 517 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580069.573627:0:5840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787580069.573631:0:5840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787580069.573641:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002c3e8c7a/0xc86deac208337f98 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d26c expref: 10 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580069.573651:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c3e8c7a/0xc86deac208337f98 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d26c expref: 10 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580069.573686:0:5840:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002c3e8c7a/0xc86deac208337f98 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d26c expref: 10 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580069.573702:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d684700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5840:1874413262804480:192.168.202.36@tcp:105: 00000100:00100000:3.0:1787580069.573773:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae51e92300 going to sleep for 11 seconds 00000100:00100000:1.0:1787580069.583027:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580069.583193:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d684700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5840:1874413262804480:192.168.202.36@tcp:105: 00010000:00010000:3.0:1787580069.583217:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787580069.583276:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae50728000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+10:2361:x1874413239722496:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 9748us (10781us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580069.583288:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 57 00000100:00100000:0.0:1787580069.583680:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239722624 00000100:00100000:0.0:1787580069.583688:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239722624 00002000:00100000:0.0:1787580069.583735:0:6711:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8fae50729880 x1874413239722624/t0(0) o4->31d1df27-21ab-4c76-bd19-e53fa778bd7e@192.168.202.36@tcp:555/0 lens 504/0 e 0 to 0 dl 1787580080 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787580069.583746:0:6711:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8fae50729880 with x1874413239722624 ext(0->12) 00002000:00010000:0.0:1787580069.583750:0:6711:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8fae50729880 00000100:00100000:0.0:1787580069.583780:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 2 00000100:00100000:0.0:1787580069.583789:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae50729880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+10:2361:x1874413239722624:12345-192.168.202.36@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787580069.584553:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae50729880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+12:2361:x1874413239722624:12345-192.168.202.36@tcp:4:lhsmtool_posix.0 Request processed in 762us (1533us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1787580069.584562:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 2 00002000:00100000:0.0:1787580069.584568:0:6711:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8fae50729880 x1874413239722624/t4294967308(0) o4->31d1df27-21ab-4c76-bd19-e53fa778bd7e@192.168.202.36@tcp:555/0 lens 504/448 e 0 to 0 dl 1787580080 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787580069.584576:0:6711:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8fae50729880 with x1874413239722624 ext(0->12) 00002000:00010000:0.0:1787580069.584580:0:6711:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8fae50729880 00000100:00100000:0.0:1787580069.604050:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580069.604380:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239722752 00000100:00100000:2.0:1787580069.604418:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239722752 00000100:00100000:2.0:1787580069.604466:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 124 00000100:00100000:2.0:1787580069.604475:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d5b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+61:10606:x1874413239722752:12345-192.168.202.36@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1787580069.701763:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d5b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+61:10606:x1874413239722752:12345-192.168.202.36@tcp:44:lhsmtool_posix.0 Request processed in 97276us (97711us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580069.701777:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 124 00000001:00080000:1.0:1787580069.701814:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967399 is committed 00000004:00080000:1.0:1787580069.701820:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000001:00080000:1.0:1787580069.701866:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:1.0:1787580069.701892:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:1.0:1787580069.701913:0:5874:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8fae5ff150c0 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1787580069.701917:0:5874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8fae6d6fad00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8fae4c523600 00000020:00080000:1.0:1787580069.701920:0:5874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8fae6d6fa100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8fae4529ec00 00000020:00080000:1.0:1787580069.701943:0:5874:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8fae4cf6c480 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1787580069.701959:0:5874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8fae50f25300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8fae4cf6cc00 00000020:00080000:1.0:1787580069.701962:0:5874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8fae50f25b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8fae4529dc00 00000004:00080000:1.0:1787580069.701986:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:1.0:1787580069.702011:0:5885:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000100:00100000:0.0:1787580069.702131:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d5baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874413262804608:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787580069.702187:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1787580069.702199:0:5885:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1787580069.702257:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d5ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874413262804736:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787580069.702281:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580069.702314:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262804608 00000100:00100000:0.0:1787580069.702322:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262804608 00000100:00100000:0.0:1787580069.702361:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262804736 00000100:00100000:0.0:1787580069.702365:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262804736 00000100:00100000:1.0:1787580069.702380:0:10268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787580069.702401:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787580069.702405:0:10268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d5b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3317:x1874413262804608:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787580069.702407:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d5b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3314:x1874413262804736:12345-0@lo:2:osp-syn-1-0.0 00002000:00080000:1.0:1787580069.702431:0:10268:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:1.0:1787580069.702454:0:10268:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000afaff75e/0xc86deac208337f9f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580069.702475:0:10268:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000080997781/0xc86deac208337d61 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1cb expref: 11 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580069.702485:0:10268:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1787580069.702490:0:10268:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787580069.702495:0:10268:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000afaff75e/0xc86deac208337f9f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580069.702523:0:10268:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000080997781/0xc86deac208337d61 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1cb expref: 11 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580069.702537:0:10268:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000080997781/0xc86deac208337d61 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1cb expref: 11 pid: 10268 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787580069.702537:0:6707:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1787580069.702540:0:6707:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787580069 00002000:00010000:0.0:1787580069.702543:0:6707:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787580069.702546:0:6707:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1787580069 -> 1787580069 00002000:00010000:0.0:1787580069.702548:0:6707:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787580069.702550:0:10268:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae50728380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10268:1874413262804864:192.168.202.36@tcp:104: 00000100:00100000:0.0:1787580069.702581:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d5b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3314:x1874413262804736:12345-0@lo:2:osp-syn-1-0.0 Request processed in 174us (299us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1787580069.702587:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787580069.702604:0:10268:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae49ef09c0 going to sleep for 11 seconds 00000004:00080000:0.0:1787580069.702629:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8fae6d5ba300/2, rc 0, transno 4294967309 00000100:00100000:0.0:1787580069.702636:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d5ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874413262804736:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787580069.702743:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787580069.702752:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7ec52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874413262804992:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787580069.702779:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787580069.710007:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262804992 00000100:00100000:2.0:1787580069.710027:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262804992 00000100:00100000:2.0:1787580069.710111:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787580069.710134:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d5b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3314:x1874413262804992:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1787580069.710171:0:6707:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:2.0:1787580069.710230:0:6707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a8c4ea4, atime: 0x6a8c4ea4, ctime: 0x6a8c4ea4, blocks: 0x1 00010000:00010000:2.0:1787580069.710243:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ed6f3eb/0xc86deac208337fa6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580069.710280:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=417s v=(0 0) 00010000:00010000:2.0:1787580069.710286:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787580069.710294:0:6707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ed6f3eb/0xc86deac208337fa6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580069.710312:0:6707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006ed6f3eb/0xc86deac208337fa6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580069.710323:0:6707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ed6f3eb/0xc86deac208337fa6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580069.710332:0:6707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006ed6f3eb/0xc86deac208337fa6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580069.710356:0:6707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787580069.710985:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d5b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3314:x1874413262804992:12345-0@lo:6:osp-syn-0-0.0 Request processed in 852us (8192us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1787580069.710995:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000004:00080000:0.0:1787580069.713521:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8fae7ec52a00/2, rc 0, transno 4294967304 00000100:00100000:0.0:1787580069.713539:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7ec52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874413262804992:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1787580069.714433:0:7642:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787580069.714447:0:7642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006ed6f3eb/0xc86deac208337fa6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580069.714463:0:7642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db8600 already unused, calling callback (ffffffffc155a230) 00010000:00010000:3.0:1787580069.714467:0:7642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006ed6f3eb/0xc86deac208337fa6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580069.714501:0:7642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006ed6f3eb/0xc86deac208337fa6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580069.714522:0:7642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006ed6f3eb/0xc86deac208337fa6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580069.714530:0:7642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006ed6f3eb/0xc86deac208337fa6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580069.714556:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787580069.714558:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787580069.714560:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787580069.720566:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580069.720693:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580069.722132:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239723008 00000100:00100000:0.0:1787580069.722147:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239723008 00010000:00010000:0.0:1787580069.722196:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000080997781/0xc86deac208337d61 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1cb expref: 12 pid: 10268 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580069.722243:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239722880 00000100:00100000:2.0:1787580069.722248:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239722880 00000100:00100000:0.0:1787580069.722272:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 58 00000100:00100000:2.0:1787580069.722278:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 43 00000100:00100000:0.0:1787580069.722281:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae50729500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+13:2359:x1874413239723008:12345-192.168.202.36@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787580069.722283:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5072b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+13:2361:x1874413239722880:12345-192.168.202.36@tcp:16:lhsmtool_posix.0 00010000:00010000:0.0:1787580069.722297:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787580069.722304:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000080997781/0xc86deac208337d61 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1cb expref: 13 pid: 10268 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.722318:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000080997781/0xc86deac208337d61 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1cb expref: 13 pid: 10268 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.722343:0:5838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787580069.722348:0:5838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787580069.722353:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000afaff75e/0xc86deac208337f9f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.722363:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000afaff75e/0xc86deac208337f9f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.722409:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787580069.722476:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae50729500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+13:2359:x1874413239723008:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 195us (1782us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580069.722484:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 58 00010000:00010000:3.0:1787580069.728296:0:10268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080997781/0xc86deac208337d61 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1cb expref: 12 pid: 10268 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580069.728322:0:10268:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae50728380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10268:1874413262804864:192.168.202.36@tcp:104: 00010000:00010000:3.0:1787580069.728346:0:10268:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000afaff75e/0xc86deac208337f9f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580069.728377:0:10268:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000afaff75e/0xc86deac208337f9f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580069.728400:0:10268:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000afaff75e/0xc86deac208337f9f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580069.728427:0:10268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000afaff75e/0xc86deac208337f9f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580069.728435:0:10268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000afaff75e/0xc86deac208337f9f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580069.728454:0:10268:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787580069.729054:0:10268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d5b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3317:x1874413262804608:12345-0@lo:6:osp-syn-1-0.0 Request processed in 26648us (26864us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1787580069.729070:0:10268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000004:00080000:3.0:1787580069.729125:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8fae6d5baa00/2, rc 0, transno 4294967310 00000100:00100000:3.0:1787580069.729132:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d5baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874413262804608:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1787580069.729711:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787580069.729719:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000afaff75e/0xc86deac208337f9f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.729742:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae41661600 already unused, calling callback (ffffffffc155a230) 00010000:00010000:0.0:1787580069.729746:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000afaff75e/0xc86deac208337f9f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.729752:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000afaff75e/0xc86deac208337f9f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.729769:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000afaff75e/0xc86deac208337f9f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.729773:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000afaff75e/0xc86deac208337f9f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.729791:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787580069.729798:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787580069.729799:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787580069.759557:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:3.0:1787580069.759576:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:3.0:1787580069.759699:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5072b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:2361:x1874413239722880:12345-192.168.202.36@tcp:16:lhsmtool_posix.0 Request processed in 37407us (39137us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580069.759711:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 43 00000100:00100000:1.0:1787580069.763121:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580069.763457:0:8897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239723264 00000100:00100000:0.0:1787580069.763469:0:8897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239723264 00000100:00100000:0.0:1787580069.763535:0:8897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 125 00000100:00100000:0.0:1787580069.763545:0:8897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5072bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+15:10606:x1874413239723264:12345-192.168.202.36@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787580069.763605:0:8897:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787580069.763642:0:8897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660600/0xc86deac208337f8a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d25e expref: 15 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.763665:0:8897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8fae5bb2fb00) 00010000:00010000:0.0:1787580069.763685:0:8897:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787580069.763720:0:8897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb200/0xc86deac208337fad lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.763746:0:8897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb200/0xc86deac208337fad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.763757:0:8897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb200/0xc86deac208337fad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787580069.764211:0:8897:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000085ff173a reply state 000000005a301a4f transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb200/0xc86deac208337fad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580069.764222:0:8897:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787580069.764619:0:8897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5072bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+16:10606:x1874413239723264:12345-192.168.202.36@tcp:36:lhsmtool_posix.0 Request processed in 1072us (1505us total) trans 4294967401 rc 0/0 00000100:00100000:0.0:1787580069.764628:0:8897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 125 00000100:00100000:2.0:1787580069.768673:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580069.769310:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239723392 00000100:00100000:3.0:1787580069.769321:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239723392 00000100:00100000:3.0:1787580069.769405:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 44 00000100:00100000:3.0:1787580069.769417:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7ec50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:2360:x1874413239723392:12345-192.168.202.36@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787580069.769652:0:6705:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1787580069.769657:0:6705:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1787580069 -> 1787580068 00002000:00010000:3.0:1787580069.769660:0:6705:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787580068 00002000:00010000:3.0:1787580069.769680:0:6705:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1787580069 -> 1787580068 00002000:00010000:3.0:1787580069.769682:0:6705:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1787580069.769752:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7ec50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+7:2360:x1874413239723392:12345-192.168.202.36@tcp:2:lhsmtool_posix.0 Request processed in 337us (1090us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1787580069.769762:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 44 00000100:00100000:2.0:1787580069.771853:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580069.771989:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239723648 00000100:00100000:1.0:1787580069.772001:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239723648 00000100:00100000:1.0:1787580069.772071:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 126 00000100:00100000:1.0:1787580069.772081:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7ec50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+16:10606:x1874413239723648:12345-192.168.202.36@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787580069.772149:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661600/0xc86deac208337fb4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580069.772167:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661200/0xc86deac208337f6e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d250 expref: 16 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580069.772176:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661600/0xc86deac208337fb4 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580069.772210:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661200/0xc86deac208337f6e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d250 expref: 16 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580069.772226:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661200/0xc86deac208337f6e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d250 expref: 16 pid: 5853 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580069.772241:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae50728380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5852:1874413262805120:192.168.202.36@tcp:104: 00000100:00100000:1.0:1787580069.772320:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae4cf6c000 going to sleep for 11 seconds 00000100:00100000:3.0:1787580069.774649:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580069.774683:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239723776 00000100:00100000:3.0:1787580069.774693:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239723776 00010000:00010000:3.0:1787580069.774739:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661200/0xc86deac208337f6e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d250 expref: 17 pid: 5853 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580069.774775:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 59 00000100:00100000:3.0:1787580069.774785:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d684700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+17:2361:x1874413239723776:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787580069.774804:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787580069.774812:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661200/0xc86deac208337f6e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d250 expref: 17 pid: 5853 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580069.774826:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661200/0xc86deac208337f6e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d250 expref: 17 pid: 5853 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580069.774847:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8fae5bb2fb00) 00010000:00010000:3.0:1787580069.774852:0:5840:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661600/0xc86deac208337fb4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580069.774861:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661600/0xc86deac208337fb4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580069.774868:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661600/0xc86deac208337fb4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580069.774913:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787580069.774960:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d684700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+17:2361:x1874413239723776:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 176us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580069.774968:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 59 00010000:00010000:1.0:1787580069.775862:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661200/0xc86deac208337f6e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d250 expref: 16 pid: 5853 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580069.775908:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae50728380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5852:1874413262805120:192.168.202.36@tcp:104: 00010000:00010000:1.0:1787580069.775930:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661600/0xc86deac208337fb4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580069.775939:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661600/0xc86deac208337fb4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580069.775945:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661600/0xc86deac208337fb4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580069.775984:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661600/0xc86deac208337fb4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580069.775991:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661600/0xc86deac208337fb4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580069.775998:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661600/0xc86deac208337fb4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580069.776004:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae41661600 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:1.0:1787580069.776009:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661600/0xc86deac208337fb4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580069.776016:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661600/0xc86deac208337fb4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580069.776027:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8fae5bb2fb00) 00010000:00010000:1.0:1787580069.776030:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787580069.776034:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661600/0xc86deac208337fb4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580069.776228:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661600/0xc86deac208337fb4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580069.776301:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7ec50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+15:10606:x1874413239723648:12345-192.168.202.36@tcp:55:lhsmtool_posix.0 Request processed in 4220us (4454us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787580069.776310:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 126 00010000:00010000:0.0:1787580069.777313:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb200/0xc86deac208337fad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.777324:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb200/0xc86deac208337fad lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.777331:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb200/0xc86deac208337fad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.777336:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae50feb200 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:0.0:1787580069.777341:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb200/0xc86deac208337fad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.777348:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb200/0xc86deac208337fad lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.777375:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8fae5bb2fb00) 00010000:00010000:0.0:1787580069.777377:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787580069.777403:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb200/0xc86deac208337fad lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.777410:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb200/0xc86deac208337fad lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580069.779473:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580069.779563:0:10268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239723904 00000100:00100000:1.0:1787580069.779573:0:10268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239723904 00000100:00100000:1.0:1787580069.779632:0:10268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 45 00000100:00100000:1.0:1787580069.779643:0:10268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d684e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+7:2360:x1874413239723904:12345-192.168.202.36@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787580069.779688:0:10268:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000003590f4d0/0xc86deac208337fbb lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580069.779707:0:10268:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002c3e8c7a/0xc86deac208337f98 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d26c expref: 7 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580069.779715:0:10268:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787580069.779720:0:10268:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787580069.779725:0:10268:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003590f4d0/0xc86deac208337fbb lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580069.779767:0:10268:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002c3e8c7a/0xc86deac208337f98 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d26c expref: 7 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580069.779781:0:10268:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002c3e8c7a/0xc86deac208337f98 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d26c expref: 7 pid: 6708 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580069.779823:0:10268:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae50728380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10268:1874413262805248:192.168.202.36@tcp:104: 00000100:00100000:1.0:1787580069.779918:0:10268:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae4cf6c000 going to sleep for 11 seconds 00000100:00100000:1.0:1787580069.782689:0:10268:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae50728380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10268:1874413262805248:192.168.202.36@tcp:104: 00010000:00010000:1.0:1787580069.782716:0:10268:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003590f4d0/0xc86deac208337fbb lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580069.784091:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580069.784233:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239724032 00000100:00100000:1.0:1787580069.784243:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239724032 00010000:00010000:1.0:1787580069.784289:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002c3e8c7a/0xc86deac208337f98 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d26c expref: 8 pid: 6708 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580069.784334:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 60 00000100:00100000:1.0:1787580069.784345:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d684000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+8:2360:x1874413239724032:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787580069.784363:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787580069.784430:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002c3e8c7a/0xc86deac208337f98 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d26c expref: 8 pid: 6708 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580069.784445:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002c3e8c7a/0xc86deac208337f98 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d26c expref: 8 pid: 6708 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580069.784473:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c3e8c7a/0xc86deac208337f98 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d26c expref: 8 pid: 6708 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580069.784491:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787580069.784509:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787580069.784516:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003590f4d0/0xc86deac208337fbb lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580069.784525:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003590f4d0/0xc86deac208337fbb lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580069.784553:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787580069.784611:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d684000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+7:2360:x1874413239724032:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 267us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580069.784619:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 60 00010000:00010000:2.0:1787580069.784927:0:10268:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003590f4d0/0xc86deac208337fbb lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580069.784944:0:10268:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003590f4d0/0xc86deac208337fbb lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580069.784968:0:10268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000003590f4d0/0xc86deac208337fbb lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580069.784987:0:10268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003590f4d0/0xc86deac208337fbb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580069.784996:0:10268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003590f4d0/0xc86deac208337fbb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580069.785003:0:10268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae41660600 already unused, calling callback (ffffffffc155a230) 00010000:00010000:2.0:1787580069.785007:0:10268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003590f4d0/0xc86deac208337fbb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580069.785017:0:10268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003590f4d0/0xc86deac208337fbb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580069.785028:0:10268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003590f4d0/0xc86deac208337fbb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580069.785036:0:10268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003590f4d0/0xc86deac208337fbb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580069.785122:0:10268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d684e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:2360:x1874413239723904:12345-192.168.202.36@tcp:1:lhsmtool_posix.0 Request processed in 5480us (5657us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580069.785132:0:10268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 45 00000100:00100000:3.0:1787580069.788873:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580069.789525:0:8897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239724288 00000100:00100000:0.0:1787580069.789538:0:8897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239724288 00000100:00100000:0.0:1787580069.789629:0:8897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 127 00000100:00100000:0.0:1787580069.789640:0:8897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d685880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+14:10606:x1874413239724288:12345-192.168.202.36@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787580069.789720:0:8897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb200/0xc86deac208337fc2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.789739:0:8897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb200/0xc86deac208337fc2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.789751:0:8897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb200/0xc86deac208337fc2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.789992:0:8897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feac00/0xc86deac208337fc9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.790003:0:8897:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660200/0xc86deac208337f7c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d257 expref: 15 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.790010:0:8897:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feac00/0xc86deac208337fc9 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.790175:0:8897:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660200/0xc86deac208337f7c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d257 expref: 15 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.790188:0:8897:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660200/0xc86deac208337f7c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d257 expref: 15 pid: 5852 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580069.790202:0:8897:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d5b9880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8897:1874413262805376:192.168.202.36@tcp:104: 00000100:00100000:0.0:1787580069.790326:0:8897:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae77a2fe40 going to sleep for 11 seconds 00000100:00100000:1.0:1787580069.795366:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580069.795535:0:8897:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d5b9880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8897:1874413262805376:192.168.202.36@tcp:104: 00010000:00010000:0.0:1787580069.795566:0:8897:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feac00/0xc86deac208337fc9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580069.795642:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239724416 00000100:00100000:3.0:1787580069.795653:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239724416 00010000:00010000:3.0:1787580069.795698:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660200/0xc86deac208337f7c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d257 expref: 16 pid: 5852 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580069.795737:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 61 00000100:00100000:3.0:1787580069.795746:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48d85850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+16:2361:x1874413239724416:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787580069.795761:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787580069.795768:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660200/0xc86deac208337f7c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d257 expref: 16 pid: 5852 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580069.795780:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660200/0xc86deac208337f7c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d257 expref: 16 pid: 5852 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580069.795885:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660200/0xc86deac208337f7c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d257 expref: 16 pid: 5852 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580069.796017:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8fae5bb2fb00) 00010000:00010000:3.0:1787580069.796024:0:5838:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feac00/0xc86deac208337fc9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580069.796053:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feac00/0xc86deac208337fc9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580069.796061:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feac00/0xc86deac208337fc9 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580069.796084:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787580069.796164:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48d85850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+15:2361:x1874413239724416:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 417us (809us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580069.796172:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 61 00010000:00010000:0.0:1787580069.796297:0:8897:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feac00/0xc86deac208337fc9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.796305:0:8897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feac00/0xc86deac208337fc9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787580069.796506:0:8897:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:0.0:1787580069.796636:0:8897:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:0.0:1787580069.796674:0:8897:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:0.0:1787580069.796741:0:8897:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d5b9880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8897:1874413262805504:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787580069.796791:0:8897:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580069.796829:0:8897:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae455b2180 going to sleep for 11 seconds 00000100:00100000:2.0:1787580069.796915:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262805504 00000100:00100000:2.0:1787580069.796921:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262805504 00000100:00100000:2.0:1787580069.796957:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787580069.796965:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d5b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8897:x1874413262805504:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787580069.797065:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d5b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8897:x1874413262805504:12345-0@lo:1000:mdt00_003.0 Request processed in 101us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580069.797072:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787580069.797721:0:8897:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:0.0:1787580069.797728:0:8897:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:0.0:1787580069.797745:0:8897:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8fae6d5ba300, transno 4294967309 00000100:00100000:0.0:1787580069.797776:0:8897:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8fae6d5baa00 x1874413262804608/t4294967310(4294967310) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787580085 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787580069.797789:0:8897:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d5b9880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8897:1874413262805504:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1787580069.798223:0:8897:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:0.0:1787580069.798284:0:8897:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d5b9880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8897:1874413262805632:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787580069.798322:0:8897:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580069.798346:0:8897:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae77a2fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1787580069.798365:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262805632 00000100:00100000:0.0:1787580069.798369:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262805632 00000100:00100000:0.0:1787580069.798415:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787580069.798423:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d5bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8897:x1874413262805632:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787580069.798572:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d5bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:8897:x1874413262805632:12345-0@lo:1000:mdt00_003.0 Request processed in 149us (248us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1787580069.798579:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787580069.798611:0:8897:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d5b9880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8897:1874413262805632:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1787580069.798637:0:8897:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feac00/0xc86deac208337fc9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.798648:0:8897:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feac00/0xc86deac208337fc9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.798656:0:8897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feac00/0xc86deac208337fc9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.798661:0:8897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae50feac00 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:0.0:1787580069.798666:0:8897:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feac00/0xc86deac208337fc9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.798684:0:8897:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feac00/0xc86deac208337fc9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.798698:0:8897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8fae5bb2fb00) 00010000:00010000:0.0:1787580069.798701:0:8897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787580069.798705:0:8897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feac00/0xc86deac208337fc9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.798711:0:8897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feac00/0xc86deac208337fc9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.798736:0:8897:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9400/0xc86deac208337f0c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.798742:0:8897:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9400/0xc86deac208337f0c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.798748:0:8897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9400/0xc86deac208337f0c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.798753:0:8897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db9400 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:0.0:1787580069.798756:0:8897:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9400/0xc86deac208337f0c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.798761:0:8897:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9400/0xc86deac208337f0c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.798768:0:8897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8fae56e35f00) 00010000:00010000:0.0:1787580069.798770:0:8897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787580069.798776:0:8897:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8000/0xc86deac208337f13 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d23b expref: 18 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.798797:0:8897:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8000/0xc86deac208337f13 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d23b expref: 18 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.798806:0:8897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8000/0xc86deac208337f13 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d23b expref: 18 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.798830:0:8897:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8000/0xc86deac208337f13 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d23b expref: 18 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580069.798840:0:8897:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d5b9500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8897:1874413262805760:192.168.202.36@tcp:105: 00000100:00100000:0.0:1787580069.798886:0:8897:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae50ee0f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787580069.804641:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580069.804780:0:8897:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d5b9500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8897:1874413262805760:192.168.202.36@tcp:105: 00010000:00010000:0.0:1787580069.804821:0:8897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9400/0xc86deac208337f0c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.804832:0:8897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9400/0xc86deac208337f0c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.804867:0:8897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea000/0xc86deac208337fd0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.804883:0:8897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea000/0xc86deac208337fd0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.804895:0:8897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea000/0xc86deac208337fd0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.804907:0:8897:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea000/0xc86deac208337fd0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.804942:0:8897:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea000/0xc86deac208337fd0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.804949:0:8897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea000/0xc86deac208337fd0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.804955:0:8897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae50fea000 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:0.0:1787580069.804960:0:8897:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea000/0xc86deac208337fd0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.804967:0:8897:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea000/0xc86deac208337fd0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.804989:0:8897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8fae56e35f00) 00010000:00010000:0.0:1787580069.804993:0:8897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787580069.804997:0:8897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea000/0xc86deac208337fd0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.805002:0:8897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea000/0xc86deac208337fd0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.805013:0:8897:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb200/0xc86deac208337fc2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.805019:0:8897:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb200/0xc86deac208337fc2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.805025:0:8897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb200/0xc86deac208337fc2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.805029:0:8897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae50feb200 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:0.0:1787580069.805038:0:8897:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb200/0xc86deac208337fc2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.805045:0:8897:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb200/0xc86deac208337fc2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.805053:0:8897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8fae56e35f00) 00010000:00010000:0.0:1787580069.805056:0:8897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787580069.805058:0:8897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb200/0xc86deac208337fc2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.805064:0:8897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb200/0xc86deac208337fc2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580069.805293:0:8897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d685880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+18:10606:x1874413239724288:12345-192.168.202.36@tcp:57:lhsmtool_posix.0 Request processed in 15653us (16427us total) trans 4294967406 rc 0/0 00000100:00100000:0.0:1787580069.805303:0:8897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 127 00000020:00080000:0.0:1787580069.805309:0:8897:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1787580069.805585:0:11700:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787580069.805590:0:11700:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787580069.806077:0:11700:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1787580069.806087:0:11700:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787580069.806696:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239724544 00000100:00100000:1.0:1787580069.806704:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239724544 00000100:00100000:1.0:1787580069.806767:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 31 00000100:00100000:1.0:1787580069.806778:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7ec50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+18:10603:x1874413239724544:12345-192.168.202.36@tcp:49:lfs.0 00000100:00100000:1.0:1787580069.806904:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7ec50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+18:10603:x1874413239724544:12345-192.168.202.36@tcp:49:lfs.0 Request processed in 128us (2275us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580069.807181:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 31 00000100:00100000:2.0:1787580069.810350:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580069.810532:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239724800 00000100:00100000:3.0:1787580069.810542:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239724800 00000100:00100000:3.0:1787580069.810604:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 128 00000100:00100000:3.0:1787580069.810615:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7ec51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+18:10603:x1874413239724800:12345-192.168.202.36@tcp:58:lfs.0 00000040:00080000:3.0:1787580069.811188:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1787580069.811286:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7ec51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+18:10603:x1874413239724800:12345-192.168.202.36@tcp:58:lfs.0 Request processed in 672us (947us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580069.811295:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 128 00000100:00100000:0.0:1787580069.815844:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580069.816005:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239725056 00000100:00100000:2.0:1787580069.816015:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239725056 00000100:00100000:2.0:1787580069.816058:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 32 00000100:00100000:2.0:1787580069.816066:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51885850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+18:10606:x1874413239725056:12345-192.168.202.36@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787580069.816690:0:5856:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787580069.816796:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:2.0:1787580069.816836:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208337fd7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580069.816852:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208337fd7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580069.816863:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208337fd7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580069.816882:0:5856:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208337fd7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580069.816889:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208337fd7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580069.816895:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208337fd7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580069.817288:0:5856:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787580069.817423:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51885850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+20:10606:x1874413239725056:12345-192.168.202.36@tcp:35:lhsmtool_posix.0 Request processed in 1354us (1585us total) trans 4294967408 rc 0/0 00000100:00100000:2.0:1787580069.817434:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 32 00000020:00080000:2.0:1787580069.817440:0:5856:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787580069.824359:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787580069.824374:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208337fd7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.824401:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db9000 already unused, calling callback (ffffffffc155a230) 00010000:00010000:0.0:1787580069.824406:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208337fd7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.824416:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208337fd7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.824435:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8fae4c7d9000) 00010000:00010000:0.0:1787580069.824458:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787580069.824465:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208337fd7 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.824471:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208337fd7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580069.824566:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787580069.824570:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787580069.824572:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787580069.846422:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580069.846522:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239725184 00000100:00100000:1.0:1787580069.846535:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239725184 00000100:00100000:1.0:1787580069.846592:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 129 00000100:00100000:1.0:1787580069.846603:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7ec50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+20:10609:x1874413239725184:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:1.0:1787580069.846636:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787580069.846679:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660e00/0xc86deac208337fde lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d273 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580069.846757:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661200/0xc86deac208337fe5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580069.846772:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661200/0xc86deac208337fe5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580069.846783:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661200/0xc86deac208337fe5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580069.846807:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660200/0xc86deac208337fec lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580069.846814:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660200/0xc86deac208337fec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580069.846821:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660200/0xc86deac208337fec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580069.847155:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660600/0xc86deac208337ff3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580069.847166:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660a00/0xc86deac208337efe lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d234 expref: 21 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580069.847174:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660600/0xc86deac208337ff3 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580069.847217:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660a00/0xc86deac208337efe lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d234 expref: 21 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580069.847245:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660a00/0xc86deac208337efe lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d234 expref: 21 pid: 8897 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580069.847263:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae50728380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5854:1874413262805888:192.168.202.36@tcp:104: 00000100:00100000:1.0:1787580069.847370:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae4cf6c000 going to sleep for 11 seconds 00000100:00100000:3.0:1787580069.850805:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580069.850916:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239725440 00000100:00100000:2.0:1787580069.850926:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239725440 00000100:00100000:2.0:1787580069.851005:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 33 00000100:00100000:2.0:1787580069.851015:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d684700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+22:5600:x1874413239725440:12345-192.168.202.36@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787580069.851289:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d684700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+23:5600:x1874413239725440:12345-192.168.202.36@tcp:35:ldlm_bl.0 Request processed in 274us (506us total) trans 4294967409 rc 0/0 00000100:00100000:2.0:1787580069.851299:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 33 00000100:00100000:1.0:1787580069.852256:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae50728380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5854:1874413262805888:192.168.202.36@tcp:104: 00010000:00010000:1.0:1787580069.852283:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660600/0xc86deac208337ff3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580069.854535:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580069.854645:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239725568 00000100:00100000:3.0:1787580069.854655:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239725568 00010000:00010000:3.0:1787580069.854698:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660a00/0xc86deac208337efe lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d234 expref: 23 pid: 8897 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580069.855063:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 62 00000100:00100000:3.0:1787580069.855076:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7ec50380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+23:2360:x1874413239725568:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787580069.855093:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787580069.855101:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660a00/0xc86deac208337efe lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d234 expref: 23 pid: 8897 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580069.855115:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660a00/0xc86deac208337efe lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d234 expref: 23 pid: 8897 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580069.855141:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660a00/0xc86deac208337efe lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d234 expref: 23 pid: 8897 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580069.855161:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8fae56e35f00) 00010000:00010000:3.0:1787580069.855166:0:5840:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660600/0xc86deac208337ff3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580069.855175:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660600/0xc86deac208337ff3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580069.855182:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660600/0xc86deac208337ff3 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580069.855218:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787580069.855278:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7ec50380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+22:2360:x1874413239725568:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 204us (750us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580069.855285:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 62 00010000:00010000:0.0:1787580069.855505:0:5854:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660600/0xc86deac208337ff3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.855514:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660600/0xc86deac208337ff3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787580069.855555:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1787580069.855560:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787580069.855578:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660600/0xc86deac208337ff3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.855590:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660600/0xc86deac208337ff3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.855600:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661200/0xc86deac208337fe5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.855607:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661200/0xc86deac208337fe5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.855614:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661200/0xc86deac208337fe5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.855620:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae41661200 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:0.0:1787580069.855625:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661200/0xc86deac208337fe5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.855649:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661200/0xc86deac208337fe5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.855659:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8fae5bb2f900) 00010000:00010000:0.0:1787580069.855662:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787580069.855666:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661200/0xc86deac208337fe5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.855672:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661200/0xc86deac208337fe5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.855684:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660200/0xc86deac208337fec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.855691:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660200/0xc86deac208337fec lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.855697:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660200/0xc86deac208337fec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.855702:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae41660200 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:0.0:1787580069.855705:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660200/0xc86deac208337fec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.855711:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660200/0xc86deac208337fec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.855719:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8fae5bb2fc00) 00010000:00010000:0.0:1787580069.855721:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787580069.855724:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660200/0xc86deac208337fec lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.855755:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660200/0xc86deac208337fec lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.855800:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660e00/0xc86deac208337fde lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d273 expref: 22 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.855815:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660600/0xc86deac208337ff3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d273 expref: 21 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580069.855822:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8fae56e35f00) 00010000:00010000:0.0:1787580069.855825:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787580069.855827:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae41660600, rc 0) 00000100:00100000:0.0:1787580069.855865:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7ec50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+21:10609:x1874413239725184:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 9264us (9489us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580069.855871:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 129 00000100:00100000:1.0:1787580070.007741:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d5b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262806016:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787580070.007811:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787580070.007901:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262806016 00000100:00100000:2.0:1787580070.007910:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262806016 00000100:00100000:2.0:1787580070.007961:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787580070.007982:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae50728380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3316:x1874413262806016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787580070.008015:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:2.0:1787580070.010352:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae50728380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3316:x1874413262806016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2376us (2534us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580070.010363:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787580070.011654:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d5b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262806016:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787580070.343093:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580070.343141:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580070.343172:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580070.343284:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239725952 00000100:00100000:3.0:1787580070.343300:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239725952 00000100:00100000:2.0:1787580070.343531:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239725696 00000100:00100000:2.0:1787580070.343536:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239725696 00000100:00100000:2.0:1787580070.343576:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 295 00000100:00100000:2.0:1787580070.343587:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ff68ada-0c43-4367-93b7-ad31684360cf+13:2361:x1874413239725696:12345-192.168.202.36@tcp:400:kworker.0 00000100:00080000:0.0:1787580070.343768:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787580070.343773:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 149 00000100:00100000:3.0:1787580070.343782:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d5bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d66e8ae-0b45-4a46-9f01-8e93d52be8ea+5:2361:x1874413239725952:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:2.0:1787580070.343938:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ff68ada-0c43-4367-93b7-ad31684360cf+13:2361:x1874413239725696:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 352us (852us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580070.343946:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 295 00000100:00100000:0.0:1787580070.345526:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239725824 00000100:00100000:0.0:1787580070.345976:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239725824 00000100:00100000:0.0:1787580070.346059:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 70 00000100:00100000:0.0:1787580070.346068:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d5b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+7:2361:x1874413239725824:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:0.0:1787580070.346132:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d5b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+7:2361:x1874413239725824:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 66us (2958us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580070.346140:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 70 00000100:00100000:3.0:1787580070.352526:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d5bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d66e8ae-0b45-4a46-9f01-8e93d52be8ea+5:2361:x1874413239725952:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 559us (1197us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580070.352556:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 149 00000100:00080000:2.0:1787580070.353071:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787580070.387573:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787580070.702941:0:12134:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787580070.702951:0:12134:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787580070.703010:0:12134:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1787580070.703017:0:12134:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1787580070.838416:0:11700:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787580070.838430:0:11700:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787580070.838469:0:11700:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1787580070.838478:0:11700:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787580070.838645:0:11700:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d684000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11700:1874413262806144:192.168.202.36@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787580070.840117:0:11700:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae5ff153c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787580070.845281:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580070.845368:0:8897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239726080 00000100:00100000:1.0:1787580070.845378:0:8897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239726080 00000100:00100000:1.0:1787580070.845480:0:8897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 130 00000100:00100000:1.0:1787580070.845491:0:8897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d5bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+22:10621:x1874413239726080:12345-192.168.202.36@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787580070.845532:0:8897:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787580070.845642:0:8897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d5bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+22:10621:x1874413239726080:12345-192.168.202.36@tcp:53:lhsmtool_posix.0 Request processed in 152us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580070.845664:0:8897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 130 00000100:00100000:3.0:1787580070.846218:0:11700:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d684000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11700:1874413262806144:192.168.202.36@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787580070.853939:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580070.854044:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239726336 00000100:00100000:3.0:1787580070.854055:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239726336 00000100:00100000:3.0:1787580070.854123:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 131 00000100:00100000:3.0:1787580070.854134:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5072b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+21:10621:x1874413239726336:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787580070.854156:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787580070.854178:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6e00/0xc86deac208337ffa lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d27a expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580070.854297:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7800/0xc86deac208338001 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580070.854313:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7800/0xc86deac208338001 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580070.854325:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7800/0xc86deac208338001 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787580070.854352:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1787580070.854542:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6e00/0xc86deac208337ffa lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d27a expref: 24 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580070.854562:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7800/0xc86deac208338001 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d27a expref: 23 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580070.854571:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8fae56e35f00) 00010000:00010000:3.0:1787580070.854574:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787580070.854578:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae5f6d7800, rc 0) 00000100:00100000:3.0:1787580070.854650:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5072b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+23:10621:x1874413239726336:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 Request processed in 518us (721us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1787580070.854658:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 131 00000100:00100000:3.0:1787580070.865588:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580070.865631:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580070.865720:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239726464 00000100:00100000:0.0:1787580070.865741:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239726464 00000100:00100000:0.0:1787580070.865818:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 8 00000100:00100000:0.0:1787580070.865830:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d684000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+23:2360:x1874413239726464:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787580070.865848:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787580070.865877:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7800/0xc86deac208338001 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d27a expref: 23 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580070.865906:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8fae56e35f00) 00010000:00010000:0.0:1787580070.865911:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787580070.865978:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d684000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+22:2360:x1874413239726464:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 150us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580070.865986:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 8 00000100:00100000:2.0:1787580070.866635:0:8897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239726720 00000100:00100000:2.0:1787580070.866642:0:8897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239726720 00000100:00100000:2.0:1787580070.866688:0:8897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 132 00000100:00100000:2.0:1787580070.866696:0:8897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d684380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+22:10621:x1874413239726720:12345-192.168.202.36@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787580070.866781:0:8897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9a00/0xc86deac20833800f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580070.866807:0:8897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9a00/0xc86deac20833800f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580070.866819:0:8897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9a00/0xc86deac20833800f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580070.867044:0:8897:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9a00/0xc86deac20833800f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580070.867071:0:8897:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9a00/0xc86deac20833800f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580070.867078:0:8897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9a00/0xc86deac20833800f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580070.867086:0:8897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db9a00 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:2.0:1787580070.867090:0:8897:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9a00/0xc86deac20833800f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580070.867099:0:8897:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9a00/0xc86deac20833800f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580070.867110:0:8897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8fae56e35f00) 00010000:00010000:2.0:1787580070.867113:0:8897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787580070.867117:0:8897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9a00/0xc86deac20833800f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580070.867122:0:8897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9a00/0xc86deac20833800f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580070.867260:0:8897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d684380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+23:10621:x1874413239726720:12345-192.168.202.36@tcp:57:lhsmtool_posix.0 Request processed in 564us (1627us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1787580070.867269:0:8897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 132 00000040:00080000:2.0:1787580070.867479:0:11700:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787580070.867484:0:11700:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787580070.868024:0:11700:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1787580070.868032:0:11700:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787580070.871746:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580070.872125:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239726976 00000100:00100000:2.0:1787580070.872137:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239726976 00000100:00100000:2.0:1787580070.872215:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 34 00000100:00100000:2.0:1787580070.872226:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d687480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+23:10621:x1874413239726976:12345-192.168.202.36@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787580070.872479:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d687480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+24:10621:x1874413239726976:12345-192.168.202.36@tcp:35:lhsmtool_posix.0 Request processed in 254us (753us total) trans 4294967412 rc 0/0 00000100:00100000:2.0:1787580070.872487:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 34 00010000:00010000:3.0:1787580071.411637:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787580072.435649:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787580072.732759:0:12185:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787580072.732768:0:12185:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787580072.732812:0:12185:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1787580072.732821:0:12185:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787580072.984928:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580072.985281:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239727232 00000100:00100000:1.0:1787580072.985292:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239727232 00000100:00100000:1.0:1787580072.985360:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 133 00000100:00100000:1.0:1787580072.985371:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7ec53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+24:10641:x1874413239727232:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:1.0:1787580072.985435:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787580072.985459:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661600/0xc86deac208338016 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d281 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580072.985564:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660a00/0xc86deac20833801d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580072.985579:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660a00/0xc86deac20833801d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580072.985591:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660a00/0xc86deac20833801d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787580072.985601:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1787580072.985727:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661600/0xc86deac208338016 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d281 expref: 27 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580072.988619:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660a00/0xc86deac20833801d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d281 expref: 26 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580072.988631:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8fae56e35f00) 00010000:00010000:1.0:1787580072.988634:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787580072.988647:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae41660a00, rc 0) 00000100:00100000:1.0:1787580072.988735:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7ec53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+26:10641:x1874413239727232:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 3364us (3813us total) trans 4294967413 rc 0/0 00000100:00100000:1.0:1787580072.988745:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 133 00000100:00080000:2.0:1787580072.989047:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787580072.995818:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580072.995940:0:8897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239727360 00000100:00100000:2.0:1787580072.995960:0:8897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239727360 00000100:00100000:2.0:1787580072.996027:0:8897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 134 00000100:00100000:2.0:1787580072.996038:0:8897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae50729c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+26:10641:x1874413239727360:12345-192.168.202.36@tcp:54:lfs.0 00010000:00010000:2.0:1787580072.996182:0:8897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9a00/0xc86deac20833802b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580072.996202:0:8897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9a00/0xc86deac20833802b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580072.996213:0:8897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9a00/0xc86deac20833802b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580072.996241:0:8897:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9a00/0xc86deac20833802b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580072.996248:0:8897:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9a00/0xc86deac20833802b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580072.996254:0:8897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9a00/0xc86deac20833802b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580072.996260:0:8897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db9a00 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:2.0:1787580072.996272:0:8897:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9a00/0xc86deac20833802b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580072.996279:0:8897:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9a00/0xc86deac20833802b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580072.996292:0:8897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8fae56e35f00) 00010000:00010000:2.0:1787580072.996295:0:8897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787580072.996300:0:8897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9a00/0xc86deac20833802b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580072.996306:0:8897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9a00/0xc86deac20833802b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580072.996375:0:8897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae50729c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+26:10641:x1874413239727360:12345-192.168.202.36@tcp:54:lfs.0 Request processed in 338us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580072.996403:0:8897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 134 00000100:00100000:2.0:1787580073.083656:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580073.083750:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239727488 00000100:00100000:3.0:1787580073.083760:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239727488 00000100:00100000:3.0:1787580073.083955:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 46 00000100:00100000:3.0:1787580073.083967:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7ec51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:2358:x1874413239727488:12345-192.168.202.36@tcp:101:cat.0 00010000:00010000:3.0:1787580073.083987:0:6707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787580073.084034:0:6707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003957c304/0xc86deac208338032 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d288 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787580073.084078:0:6707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a8c4ea4, atime: 0x6a8c4ea4, ctime: 0x6a8c4ea4, blocks: 0xb 00010000:00010000:3.0:1787580073.084102:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=420s v=(0 0) 00010000:00010000:3.0:1787580073.084107:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787580073.084118:0:6707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003957c304/0xc86deac208338032 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d288 expref: 7 pid: 6707 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580073.084139:0:6707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003957c304/0xc86deac208338032 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d288 expref: 7 pid: 6707 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580073.084154:0:6707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae5f6d7e00, rc 0) 00000100:00100000:3.0:1787580073.084217:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7ec51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+7:2358:x1874413239727488:12345-192.168.202.36@tcp:101:cat.0 Request processed in 252us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580073.084224:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 46 00000100:00080000:2.0:1787580073.084434:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787580073.095713:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580073.095960:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239727616 00000100:00100000:0.0:1787580073.095972:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239727616 00002000:00100000:0.0:1787580073.096034:0:6713:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff8fae7ec53b80 x1874413239727616/t0(0) o3->31d1df27-21ab-4c76-bd19-e53fa778bd7e@192.168.202.36@tcp:559/0 lens 488/0 e 0 to 0 dl 1787580084 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787580073.096046:0:6713:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8fae7ec53b80 with x1874413239727616 ext(0->4095) 00002000:00010000:0.0:1787580073.096052:0:6713:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8fae7ec53b80 00000100:00100000:0.0:1787580073.096086:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 3 00000100:00100000:0.0:1787580073.096096:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7ec53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+7:2361:x1874413239727616:12345-192.168.202.36@tcp:3:cat.0 00000100:00100000:0.0:1787580073.096345:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7ec53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+7:2361:x1874413239727616:12345-192.168.202.36@tcp:3:cat.0 Request processed in 249us (643us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787580073.096353:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 3 00002000:00100000:0.0:1787580073.096366:0:6713:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff8fae7ec53b80 x1874413239727616/t0(0) o3->31d1df27-21ab-4c76-bd19-e53fa778bd7e@192.168.202.36@tcp:559/0 lens 488/4536 e 0 to 0 dl 1787580084 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787580073.096375:0:6713:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8fae7ec53b80 with x1874413239727616 ext(0->4095) 00002000:00010000:0.0:1787580073.096378:0:6713:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8fae7ec53b80 00000001:00080000:2.0:1787580073.135229:0:6733:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:2.0:1787580073.135249:0:6733:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:2.0:1787580073.135256:0:6733:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00010000:00010000:1.0:1787580073.461065:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787580074.100069:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787580074.100097:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7ec50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262806272:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787580074.100177:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787580074.100246:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262806272 00000100:00100000:2.0:1787580074.100256:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262806272 00000100:00100000:2.0:1787580074.100322:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787580074.100335:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae50b50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262806272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787580074.100424:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787580074.100478:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae50b50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262806272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 144us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580074.100486:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:2.0:1787580074.100698:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787580074.100734:0:3316:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1787580074.100741:0:3316:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:2.0:1787580074.100764:0:3316:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8fae7ec52a00, transno 4294967304 00000100:00100000:2.0:1787580074.100786:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7ec50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262806272:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787580074.485472:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787580074.613824:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d5ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874413262806528:0@lo:400:kworker.0 00000100:00100000:0.0:1787580074.613925:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580074.614126:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7efcad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874413262807040:0@lo:400:kworker.0 00000100:00100000:0.0:1787580074.614155:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580074.614190:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787580074.614196:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d5b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3315:1874413262806400:0@lo:400:kworker.0 00000100:00100000:0.0:1787580074.614228:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580074.614252:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7efca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1874413262806912:0@lo:400:kworker.0 00000100:00100000:0.0:1787580074.614287:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580074.614318:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d5bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874413262806656:0@lo:400:kworker.0 00000100:00100000:0.0:1787580074.614344:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580074.614366:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787580074.614372:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d5b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262806784:0@lo:400:kworker.0 00000100:00100000:0.0:1787580074.614422:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580074.614455:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262806528 00000100:00100000:0.0:1787580074.614464:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262806528 00000100:00100000:0.0:1787580074.614513:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262806912 00000100:00100000:0.0:1787580074.614516:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262806912 00000100:00100000:0.0:1787580074.614540:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262806656 00000100:00100000:0.0:1787580074.614544:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262806656 00000100:00100000:0.0:1787580074.614562:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787580074.614571:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7efcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874413262806528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787580074.614643:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7efcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874413262806528:12345-0@lo:400:kworker.0 Request processed in 72us (719us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580074.614650:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787580074.614666:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787580074.614672:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7efc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874413262806912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787580074.614693:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7efc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874413262806912:12345-0@lo:400:kworker.0 Request processed in 22us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580074.614698:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787580074.614707:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787580074.614712:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7efcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874413262806656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787580074.614736:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7efcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874413262806656:12345-0@lo:400:kworker.0 Request processed in 24us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580074.614741:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787580074.614757:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262807040 00000100:00100000:0.0:1787580074.614761:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262807040 00000100:00100000:0.0:1787580074.614786:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262806784 00000100:00100000:0.0:1787580074.614789:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262806784 00000100:00100000:0.0:1787580074.614805:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787580074.614812:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7efc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3315:x1874413262807040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787580074.614843:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7efc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3315:x1874413262807040:12345-0@lo:400:kworker.0 Request processed in 32us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580074.614849:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787580074.614860:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787580074.614865:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7efc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262806784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787580074.614891:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7efc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262806784:12345-0@lo:400:kworker.0 Request processed in 26us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580074.614905:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787580074.614923:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262806400 00000100:00100000:0.0:1787580074.614940:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262806400 00000100:00100000:0.0:1787580074.614967:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1787580074.614974:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:3315:x1874413262806400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787580074.615008:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:3315:x1874413262806400:12345-0@lo:400:kworker.0 Request processed in 34us (779us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580074.615014:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00080000:0.0:1787580074.615054:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787580074.615059:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787580074.615084:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d5b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3315:1874413262806400:0@lo:400:kworker.0 00000100:00100000:0.0:1787580074.615096:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7efca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1874413262806912:0@lo:400:kworker.0 00000100:00100000:0.0:1787580074.615107:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d5ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874413262806528:0@lo:400:kworker.0 00000100:00100000:0.0:1787580074.615117:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7efcad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874413262807040:0@lo:400:kworker.0 00000100:00100000:0.0:1787580074.615154:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d5b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262806784:0@lo:400:kworker.0 00000100:00100000:0.0:1787580074.615163:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d5bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874413262806656:0@lo:400:kworker.0 00000001:00080000:1.0:1787580074.745102:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967406 is committed 00000020:00080000:1.0:1787580074.745119:0:5874:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8fae50970780 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1787580074.745124:0:5874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8fae5f912100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8fae50970240 00000020:00080000:1.0:1787580074.745127:0:5874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8fae5f912200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8fae5fdddc00 00000020:00080000:3.0:1787580074.745255:0:5885:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 1 00000020:00080000:3.0:1787580074.745563:0:5885:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000001:00080000:1.0:1787580074.750977:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:1.0:1787580074.750992:0:5874:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000100:00100000:1.0:1787580075.123804:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7efcad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262807168:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787580075.123899:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580075.124364:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262807168 00000100:00100000:3.0:1787580075.124373:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262807168 00000100:00100000:3.0:1787580075.124443:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787580075.124454:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae50728a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3316:x1874413262807168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787580075.124489:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787580075.124546:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae50728a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3316:x1874413262807168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580075.124568:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787580075.125085:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7efcad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262807168:0@lo:13:osp-pre-1-0.0 00000001:00080000:0.0:1787580075.218764:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:0.0:1787580075.218789:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000100:00100000:0.0:1787580075.467374:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580075.467461:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580075.467490:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580075.467509:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580075.467546:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580075.467576:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239728256 00000100:00100000:0.0:1787580075.467586:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239728256 00000100:00100000:0.0:1787580075.467644:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239727872 00000100:00100000:1.0:1787580075.467645:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239727744 00000100:00100000:0.0:1787580075.467647:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239727872 00000100:00100000:1.0:1787580075.467648:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239727744 00000100:00100000:0.0:1787580075.467671:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 153 00000100:00100000:1.0:1787580075.467674:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 297 00000100:00100000:1.0:1787580075.467681:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ff68ada-0c43-4367-93b7-ad31684360cf+13:2360:x1874413239727744:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:0.0:1787580075.467682:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7efca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d66e8ae-0b45-4a46-9f01-8e93d52be8ea+5:2360:x1874413239728256:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:0.0:1787580075.467762:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7efca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d66e8ae-0b45-4a46-9f01-8e93d52be8ea+5:2360:x1874413239728256:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 77us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580075.467770:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 153 00000100:00100000:0.0:1787580075.467787:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 154 00000100:00100000:0.0:1787580075.467793:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7efcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+13:2360:x1874413239727872:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:3.0:1787580075.467976:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239728000 00000100:00100000:3.0:1787580075.467987:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239728000 00000100:00100000:3.0:1787580075.468014:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239728128 00000100:00100000:3.0:1787580075.468017:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239728128 00000100:00100000:3.0:1787580075.468034:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 73 00000100:00100000:3.0:1787580075.468041:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7efcad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+5:2360:x1874413239728000:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:1.0:1787580075.469633:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ff68ada-0c43-4367-93b7-ad31684360cf+13:2360:x1874413239727744:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 1937us (2253us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580075.469648:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 297 00000100:00080000:1.0:1787580075.469741:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787580075.469748:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787580075.469751:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787580075.469772:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 74 00000100:00100000:1.0:1787580075.469789:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d5bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:2360:x1874413239728128:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:1.0:1787580075.469971:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d5bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:2360:x1874413239728128:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 188us (2424us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580075.469979:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 74 00000100:00100000:0.0:1787580075.470647:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7efcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+13:2360:x1874413239727872:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 2849us (3132us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580075.470659:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 154 00000100:00100000:3.0:1787580075.477364:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7efcad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+5:2360:x1874413239728000:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 9312us (9891us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580075.477395:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 73 00010000:00010000:3.0:1787580075.514735:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787580076.027808:0:11700:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787580076.027816:0:11700:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787580076.028129:0:11700:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:1.0:1787580076.028137:0:11700:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787580076.537147:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787580077.558101:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787580078.579624:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787580078.661236:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580078.661900:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239728384 00000100:00100000:1.0:1787580078.661912:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239728384 00000100:00100000:1.0:1787580078.662002:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 135 00000100:00100000:1.0:1787580078.662014:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d5b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+13:10270:x1874413239728384:12345-192.168.202.36@tcp:60:lhsmtool_posix.0 00000100:00080000:0.0:1787580078.662182:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787580078.662632:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d5b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+13:10270:x1874413239728384:12345-192.168.202.36@tcp:60:lhsmtool_posix.0 Request processed in 620us (1407us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580078.662639:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 135 00000100:00100000:2.0:1787580078.670305:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580078.671425:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239728640 00000100:00100000:3.0:1787580078.671438:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239728640 00000100:00100000:3.0:1787580078.671515:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 35 00000100:00100000:3.0:1787580078.671525:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7ec50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+13:10270:x1874413239728640:12345-192.168.202.36@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787580078.672684:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7ec50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+14:10270:x1874413239728640:12345-192.168.202.36@tcp:35:lhsmtool_posix.0 Request processed in 1151us (2381us total) trans 4294967414 rc 0/0 00000100:00100000:3.0:1787580078.672697:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 35 00000100:00100000:2.0:1787580078.990786:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580078.991109:0:8897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239728768 00000100:00100000:1.0:1787580078.991123:0:8897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239728768 00000100:00100000:1.0:1787580078.991233:0:8897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 136 00000100:00100000:1.0:1787580078.991245:0:8897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7ec53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8d66e8ae-0b45-4a46-9f01-8e93d52be8ea+5:11093:x1874413239728768:12345-192.168.202.36@tcp:101:lsof.0 00010000:00010000:1.0:1787580078.991266:0:8897:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787580078.991288:0:8897:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661600/0xc86deac208338039 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d28f expref: -99 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580078.991355:0:8897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660200/0xc86deac208338040 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580078.991370:0:8897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660200/0xc86deac208338040 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580078.991430:0:8897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660200/0xc86deac208338040 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787580078.991653:0:8897:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787580078.991658:0:8897:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1787580078.991759:0:8897:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660200/0xc86deac208338040 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580078.991786:0:8897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661600/0xc86deac208338039 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d28f expref: 7 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580078.991805:0:8897:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660200/0xc86deac208338040 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d28f expref: 6 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580078.991814:0:8897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fae5bb2ff00) 00010000:00010000:1.0:1787580078.991817:0:8897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787580078.991820:0:8897:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae41660200, rc 0) 00000100:00100000:1.0:1787580078.991907:0:8897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7ec53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8d66e8ae-0b45-4a46-9f01-8e93d52be8ea+6:11093:x1874413239728768:12345-192.168.202.36@tcp:101:lsof.0 Request processed in 663us (1132us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580078.991914:0:8897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 136 00000100:00080000:0.0:1787580078.992038:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787580079.220611:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787580079.220639:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7ec53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262807296:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787580079.220723:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580079.220982:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262807296 00000100:00100000:3.0:1787580079.220992:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262807296 00000100:00100000:3.0:1787580079.221065:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787580079.221077:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae50729180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262807296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787580079.221126:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787580079.221184:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae50729180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262807296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580079.221192:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787580079.221242:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7ec53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262807296:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787580079.221336:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787580079.604165:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787580079.731728:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d685500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3314:1874413262807424:0@lo:400:kworker.0 00000100:00100000:1.0:1787580079.731834:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787580079.731982:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262807424 00000100:00100000:2.0:1787580079.731991:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262807424 00000100:00100000:2.0:1787580079.732037:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1787580079.732054:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:3314:x1874413262807424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787580079.732197:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d685c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874413262807552:0@lo:400:kworker.0 00000100:00100000:0.0:1787580079.732233:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580079.732268:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262807552 00000100:00100000:0.0:1787580079.732271:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262807552 00000100:00100000:0.0:1787580079.732292:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787580079.732296:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d5ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874413262807552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787580079.732322:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d5ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874413262807552:12345-0@lo:400:kworker.0 Request processed in 25us (88us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580079.732342:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787580079.732376:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d685c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874413262807552:0@lo:400:kworker.0 00000100:00100000:2.0:1787580079.742370:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:3314:x1874413262807424:12345-0@lo:400:kworker.0 Request processed in 10301us (10520us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580079.742405:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1787580079.743797:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d685500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3314:1874413262807424:0@lo:400:kworker.0 00000100:00100000:2.0:1787580079.748068:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787580079.748349:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787580079.748375:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d685c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262807808:0@lo:400:kworker.0 00000100:00100000:1.0:1787580079.748486:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787580079.748539:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262807808 00000100:00100000:1.0:1787580079.748547:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262807808 00000100:00100000:1.0:1787580079.748600:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787580079.748609:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5072b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262807808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787580079.748662:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5072b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262807808:12345-0@lo:400:kworker.0 Request processed in 53us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580079.748670:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787580079.748729:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d685c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262807808:0@lo:400:kworker.0 00000100:00100000:2.0:1787580079.764903:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d685500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1874413262807680:0@lo:400:kworker.0 00000100:00100000:2.0:1787580079.764982:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580079.766511:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262807680 00000100:00100000:0.0:1787580079.766524:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262807680 00000100:00100000:0.0:1787580079.766595:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787580079.766606:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7ec51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874413262807680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787580079.766693:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7ec51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874413262807680:12345-0@lo:400:kworker.0 Request processed in 90us (1711us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580079.766701:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00080000:0.0:1787580079.766731:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787580079.769001:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d685500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1874413262807680:0@lo:400:kworker.0 00000100:00100000:3.0:1787580079.770967:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d685500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874413262807936:0@lo:400:kworker.0 00000100:00100000:3.0:1787580079.771408:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580079.771478:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae48c93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874413262808064:0@lo:400:kworker.0 00000100:00100000:3.0:1787580079.771507:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580079.771542:0:10268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262808064 00000100:00100000:3.0:1787580079.771549:0:10268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262808064 00000100:00100000:3.0:1787580079.771600:0:10268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787580079.771610:0:10268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1874413262808064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787580079.771675:0:10268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1874413262808064:12345-0@lo:400:kworker.0 Request processed in 66us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580079.771683:0:10268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:3.0:1787580079.771704:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787580079.771730:0:3315:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:3.0:1787580079.771735:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8fae6d5baa00, transno 4294967310 00000004:00080000:3.0:1787580079.771746:0:3315:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:3.0:1787580079.771767:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae48c93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874413262808064:0@lo:400:kworker.0 00000100:00100000:1.0:1787580079.772403:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262807936 00000100:00100000:1.0:1787580079.772410:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262807936 00000100:00100000:1.0:1787580079.772466:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787580079.772474:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d685c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874413262807936:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787580079.772634:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787580079.776189:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d685c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874413262807936:12345-0@lo:400:kworker.0 Request processed in 3702us (4768us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580079.776207:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787580079.778985:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d685500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874413262807936:0@lo:400:kworker.0 00000001:00080000:1.0:1787580079.781192:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:1.0:1787580079.781210:0:5874:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:0.0:1787580079.781335:0:5885:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1787580079.781359:0:5885:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1787580080.243682:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d5b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262808192:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787580080.243783:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787580080.245233:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262808192 00000100:00100000:2.0:1787580080.245270:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262808192 00000100:00100000:2.0:1787580080.245338:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787580080.245350:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262808192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787580080.245412:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787580080.260712:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262808192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 15340us (16905us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580080.260730:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787580080.270978:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d5b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262808192:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787580080.581686:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580080.581776:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580080.581814:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580080.581843:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580080.581889:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580080.581942:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239729280 00000100:00100000:2.0:1787580080.581954:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239729280 00000100:00100000:2.0:1787580080.582028:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239729152 00000100:00100000:2.0:1787580080.582031:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239729152 00000100:00100000:2.0:1787580080.582067:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 77 00000100:00100000:2.0:1787580080.582078:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae50728000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:2358:x1874413239729280:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:2.0:1787580080.582157:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae50728000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:2358:x1874413239729280:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 81us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580080.582165:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 77 00000100:00100000:2.0:1787580080.582181:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 78 00000100:00100000:2.0:1787580080.582188:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae50729500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+5:2358:x1874413239729152:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:2.0:1787580080.582227:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae50729500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+5:2358:x1874413239729152:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 39us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580080.582233:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 78 00000100:00080000:2.0:1787580080.582249:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787580080.582254:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787580080.582822:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239728896 00000100:00100000:3.0:1787580080.582829:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239728896 00000100:00100000:3.0:1787580080.582892:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 299 00000100:00100000:3.0:1787580080.582901:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ff68ada-0c43-4367-93b7-ad31684360cf+13:2358:x1874413239728896:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:3.0:1787580080.582944:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ff68ada-0c43-4367-93b7-ad31684360cf+13:2358:x1874413239728896:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 45us (1129us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580080.582984:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 299 00000100:00100000:0.0:1787580080.593862:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239729024 00000100:00100000:0.0:1787580080.593889:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239729024 00000100:00100000:0.0:1787580080.594049:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239729408 00000100:00100000:0.0:1787580080.594053:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239729408 00000100:00100000:2.0:1787580080.594129:0:8897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 158 00000100:00100000:2.0:1787580080.594142:0:8897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae50728380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+13:2358:x1874413239729024:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:2.0:1787580080.594240:0:8897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae50728380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+13:2358:x1874413239729024:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 101us (12564us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580080.594260:0:8897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 158 00000100:00100000:2.0:1787580080.594279:0:8897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 159 00000100:00100000:2.0:1787580080.594296:0:8897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7efd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8d66e8ae-0b45-4a46-9f01-8e93d52be8ea+6:2358:x1874413239729408:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:2.0:1787580080.594325:0:8897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7efd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8d66e8ae-0b45-4a46-9f01-8e93d52be8ea+6:2358:x1874413239729408:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 40us (12449us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580080.594332:0:8897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 159 00000100:00080000:1.0:1787580080.594396:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787580080.628149:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787580081.651813:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787580082.675666:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787580083.520822:0:12387:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 10:01:22 (1787580082) 00010000:00010000:1.0:1787580083.702017:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787580084.342567:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7ec52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874413262808320:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787580084.342654:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787580084.342812:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262808320 00000100:00100000:2.0:1787580084.342821:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262808320 00000100:00100000:2.0:1787580084.342901:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787580084.342911:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7efd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874413262808320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787580084.342955:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787580084.343007:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7efd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874413262808320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580084.343015:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787580084.343059:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7ec52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874413262808320:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787580084.344979:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787580084.725055:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787580084.851950:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae48c91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874413262808704:0@lo:400:kworker.0 00000100:00100000:1.0:1787580084.851965:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae48c90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874413262808576:0@lo:400:kworker.0 00000100:00100000:0.0:1787580084.852064:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae48c90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3314:1874413262808448:0@lo:400:kworker.0 00000100:00100000:2.0:1787580084.852089:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae48c90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1874413262808832:0@lo:400:kworker.0 00000100:00100000:1.0:1787580084.856239:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580084.864099:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262808576 00000100:00100000:3.0:1787580084.864117:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262808576 00000100:00100000:3.0:1787580084.864180:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787580084.864190:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7efd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874413262808576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787580084.864281:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7efd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874413262808576:12345-0@lo:400:kworker.0 Request processed in 92us (8051us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580084.864289:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787580084.864358:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae48c90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874413262808576:0@lo:400:kworker.0 00000100:00100000:3.0:1787580084.864418:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580084.864518:0:8897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262808704 00000100:00100000:3.0:1787580084.864523:0:8897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262808704 00000100:00100000:3.0:1787580084.864556:0:8897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787580084.864563:0:8897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874413262808704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787580084.864599:0:8897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874413262808704:12345-0@lo:400:kworker.0 Request processed in 36us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580084.864605:0:8897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00080000:3.0:1787580084.864622:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787580084.864641:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae48c91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874413262808704:0@lo:400:kworker.0 00000100:00100000:0.0:1787580084.864795:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580084.864834:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae779adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874413262808960:0@lo:400:kworker.0 00000100:00100000:0.0:1787580084.864895:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580084.864953:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262808960 00000100:00100000:0.0:1787580084.864958:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262808960 00000100:00100000:0.0:1787580084.865004:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787580084.865014:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d5b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874413262808960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787580084.865068:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d5b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874413262808960:12345-0@lo:400:kworker.0 Request processed in 58us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580084.865077:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787580084.865100:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262808448 00000100:00100000:0.0:1787580084.865105:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262808448 00000100:00100000:0.0:1787580084.865134:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1787580084.865142:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:3314:x1874413262808448:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787580084.865163:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787580084.865192:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:3314:x1874413262808448:12345-0@lo:400:kworker.0 Request processed in 50us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580084.865211:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1787580084.865243:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae48c90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3314:1874413262808448:0@lo:400:kworker.0 00000100:00100000:0.0:1787580084.865253:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae779adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874413262808960:0@lo:400:kworker.0 00000100:00100000:2.0:1787580084.867714:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580084.871098:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262808832 00000100:00100000:0.0:1787580084.871116:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262808832 00000100:00100000:0.0:1787580084.871211:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1787580084.871223:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7ec52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1874413262808832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787580084.871337:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7ec52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1874413262808832:12345-0@lo:400:kworker.0 Request processed in 116us (3628us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580084.871346:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787580084.871828:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae48c90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1874413262808832:0@lo:400:kworker.0 00000100:00080000:1.0:1787580084.876034:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787580084.972481:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580084.972534:0:8897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239729664 00000100:00100000:1.0:1787580084.972545:0:8897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239729664 00000100:00100000:1.0:1787580084.972615:0:8897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 137 00000100:00100000:1.0:1787580084.972626:0:8897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7efd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+13:11359:x1874413239729664:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787580084.972647:0:8897:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787580084.972666:0:8897:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660e00/0xc86deac208338047 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d296 expref: -99 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580084.972735:0:8897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661600/0xc86deac20833804e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580084.972750:0:8897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661600/0xc86deac20833804e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580084.972761:0:8897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661600/0xc86deac20833804e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580084.972774:0:8897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661200/0xc86deac208338055 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580084.972780:0:8897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661200/0xc86deac208338055 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580084.972801:0:8897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661200/0xc86deac208338055 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580084.973300:0:8897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58000/0xc86deac20833805c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580084.973310:0:8897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58000/0xc86deac20833805c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580084.973317:0:8897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58000/0xc86deac20833805c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787580084.973326:0:8897:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1787580084.973550:0:8897:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661600/0xc86deac20833804e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580084.973558:0:8897:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661600/0xc86deac20833804e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580084.973565:0:8897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661600/0xc86deac20833804e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580084.973571:0:8897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae41661600 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:1.0:1787580084.973575:0:8897:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661600/0xc86deac20833804e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580084.973582:0:8897:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661600/0xc86deac20833804e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580084.973596:0:8897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8fae56e35700) 00010000:00010000:1.0:1787580084.973599:0:8897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787580084.973610:0:8897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661600/0xc86deac20833804e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580084.973616:0:8897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661600/0xc86deac20833804e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580084.973630:0:8897:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661200/0xc86deac208338055 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580084.973636:0:8897:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661200/0xc86deac208338055 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580084.973642:0:8897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661200/0xc86deac208338055 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580084.973646:0:8897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae41661200 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:1.0:1787580084.973649:0:8897:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661200/0xc86deac208338055 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580084.973656:0:8897:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661200/0xc86deac208338055 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580084.973664:0:8897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8fae5bb2f200) 00010000:00010000:1.0:1787580084.973667:0:8897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787580084.973669:0:8897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661200/0xc86deac208338055 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580084.973675:0:8897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41661200/0xc86deac208338055 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580084.974079:0:8897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660e00/0xc86deac208338047 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d296 expref: 16 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580084.974109:0:8897:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58000/0xc86deac20833805c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d296 expref: 15 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580084.974117:0:8897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8fae5bb2f000) 00010000:00010000:1.0:1787580084.974119:0:8897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787580084.974122:0:8897:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae4ca58000, rc 0) 00000100:00100000:1.0:1787580084.974190:0:8897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7efd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+15:11359:x1874413239729664:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 Request processed in 1565us (1720us total) trans 4294967415 rc 0/0 00000100:00100000:1.0:1787580084.974199:0:8897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 137 00000100:00080000:1.0:1787580084.974351:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787580084.977453:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580084.977487:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580084.977554:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239729792 00000100:00100000:3.0:1787580084.977565:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239729792 00000100:00100000:0.0:1787580084.977608:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239729920 00000100:00100000:0.0:1787580084.977613:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239729920 00000100:00100000:3.0:1787580084.977625:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 9 00000100:00100000:0.0:1787580084.977640:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 138 00000100:00100000:3.0:1787580084.977646:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7efda300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+16:2358:x1874413239729792:12345-192.168.202.36@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787580084.977646:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7efd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+16:11359:x1874413239729920:12345-192.168.202.36@tcp:59:lhsmtool_posix.0 00010000:00010000:3.0:1787580084.977677:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787580084.977705:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58000/0xc86deac20833805c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d296 expref: 16 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580084.977723:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8fae5bb2f000) 00010000:00010000:3.0:1787580084.977727:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787580084.977755:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7efd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+15:11359:x1874413239729920:12345-192.168.202.36@tcp:59:lhsmtool_posix.0 Request processed in 103us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580084.977772:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 138 00000100:00100000:3.0:1787580084.982615:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7efda300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+14:2358:x1874413239729792:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 4968us (5114us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580084.982897:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 9 00000040:00080000:2.0:1787580085.236340:0:11700:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787580085.236357:0:11700:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787580085.236876:0:11700:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1787580085.236895:0:11700:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787580085.367987:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787580085.368019:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d5baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874413262809088:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787580085.368091:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580085.368161:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262809088 00000100:00100000:0.0:1787580085.368170:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262809088 00000100:00100000:0.0:1787580085.368218:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787580085.368227:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d5b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874413262809088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787580085.368262:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787580085.368311:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d5b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874413262809088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580085.368318:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787580085.368374:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d5baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874413262809088:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787580085.704420:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580085.704475:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580085.704516:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580085.704539:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580085.704563:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580085.704594:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239730048 00000100:00100000:1.0:1787580085.704604:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239730048 00000100:00100000:1.0:1787580085.704667:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 301 00000100:00100000:1.0:1787580085.704678:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ff68ada-0c43-4367-93b7-ad31684360cf+13:2358:x1874413239730048:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:1.0:1787580085.704760:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ff68ada-0c43-4367-93b7-ad31684360cf+13:2358:x1874413239730048:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 73us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580085.704769:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 301 00000100:00100000:1.0:1787580085.704805:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239730432 00000100:00100000:1.0:1787580085.704815:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239730432 00000100:00100000:1.0:1787580085.704857:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239730304 00000100:00100000:1.0:1787580085.704861:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239730304 00000100:00100000:1.0:1787580085.704884:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 80 00000100:00100000:1.0:1787580085.704890:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fad43124000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:2358:x1874413239730432:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:1.0:1787580085.704920:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fad43124000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:2358:x1874413239730432:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 30us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580085.704926:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 80 00000100:00100000:1.0:1787580085.704937:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 81 00000100:00100000:1.0:1787580085.704943:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fad43127b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+5:2358:x1874413239730304:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:1.0:1787580085.704964:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fad43127b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+5:2358:x1874413239730304:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 21us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580085.704983:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 81 00000100:00100000:1.0:1787580085.705000:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239730176 00000100:00100000:1.0:1787580085.705004:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239730176 00000100:00100000:1.0:1787580085.705036:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239730560 00000100:00100000:1.0:1787580085.705039:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239730560 00000100:00100000:1.0:1787580085.705058:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 163 00000100:00100000:1.0:1787580085.705064:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fad43124e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+14:2358:x1874413239730176:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:1.0:1787580085.705092:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fad43124e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+14:2358:x1874413239730176:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 29us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580085.705099:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 163 00000100:00100000:1.0:1787580085.705109:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 164 00000100:00100000:1.0:1787580085.705115:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fad43125c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8d66e8ae-0b45-4a46-9f01-8e93d52be8ea+6:2358:x1874413239730560:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:1.0:1787580085.705136:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fad43125c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8d66e8ae-0b45-4a46-9f01-8e93d52be8ea+6:2358:x1874413239730560:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 21us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580085.705145:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 164 00000100:00080000:1.0:1787580085.705282:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787580085.705287:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787580085.705289:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787580085.750201:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787580086.259635:0:11700:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787580086.259659:0:11700:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787580086.260124:0:11700:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:2.0:1787580086.260132:0:11700:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787580086.771733:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787580087.326294:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580087.326429:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239730688 00000100:00100000:3.0:1787580087.326442:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239730688 00000100:00100000:3.0:1787580087.326523:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 139 00000100:00100000:3.0:1787580087.326534:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fad43127800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+14:11402:x1874413239730688:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:3.0:1787580087.326558:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787580087.326581:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6a00/0xc86deac20833806a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d29d expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787580087.326926:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787580087.327017:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7000/0xc86deac208338071 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580087.327033:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7000/0xc86deac208338071 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580087.327048:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7000/0xc86deac208338071 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580087.327063:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6e00/0xc86deac208338078 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580087.327085:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6e00/0xc86deac208338078 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580087.327093:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6e00/0xc86deac208338078 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580087.327378:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7000/0xc86deac208338071 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580087.327553:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7000/0xc86deac208338071 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580087.327560:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7000/0xc86deac208338071 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580087.327567:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae5f6d7000 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:3.0:1787580087.327571:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7000/0xc86deac208338071 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580087.327579:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7000/0xc86deac208338071 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580087.327594:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fae5bb2ff00) 00010000:00010000:3.0:1787580087.327598:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787580087.327603:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7000/0xc86deac208338071 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580087.327609:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7000/0xc86deac208338071 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580087.327622:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6e00/0xc86deac208338078 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580087.327635:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6e00/0xc86deac208338078 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580087.327863:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6e00/0xc86deac208338078 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580087.327868:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae5f6d6e00 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:3.0:1787580087.327871:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6e00/0xc86deac208338078 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580087.327877:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6e00/0xc86deac208338078 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580087.327885:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8fae530b1800) 00010000:00010000:3.0:1787580087.327888:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787580087.327891:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6e00/0xc86deac208338078 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580087.327896:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6e00/0xc86deac208338078 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580087.328008:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6a00/0xc86deac20833806a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d29d expref: 15 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580087.328019:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fae5bb2ff00) 00010000:00010000:3.0:1787580087.328021:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787580087.328025:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6a00/0xc86deac20833806a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d29d expref: 15 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580087.328035:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae5f6d6a00, rc 0) 00000100:00100000:3.0:1787580087.328170:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fad43127800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+14:11402:x1874413239730688:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 1637us (1891us total) trans 0 rc 301/301 00000100:00100000:3.0:1787580087.328179:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 139 00000100:00100000:1.0:1787580087.365812:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580087.367567:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239730944 00000100:00100000:0.0:1787580087.367583:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239730944 00000100:00100000:0.0:1787580087.367658:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 140 00000100:00100000:0.0:1787580087.367670:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fad43126a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+14:11402:x1874413239730944:12345-192.168.202.36@tcp:36:lfs.0 00010000:00010000:0.0:1787580087.367728:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787580087.367755:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58a00/0xc86deac2083379e8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d0d6 expref: 14 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580087.367773:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fae5bb2ff00) 00010000:00010000:0.0:1787580087.367779:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787580087.368066:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50febe00/0xc86deac20833807f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580087.368092:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660200/0xc86deac208338040 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d28f expref: 5 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580087.368101:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50febe00/0xc86deac20833807f lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580087.368137:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660200/0xc86deac208338040 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d28f expref: 5 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580087.368153:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660200/0xc86deac208338040 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d28f expref: 5 pid: 8897 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580087.368168:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d5baa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5853:1874413262809216:192.168.202.36@tcp:104: 00000100:00100000:0.0:1787580087.368269:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae7eec2a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787580087.377445:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d5baa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5853:1874413262809216:192.168.202.36@tcp:104: 00010000:00010000:2.0:1787580087.377475:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50febe00/0xc86deac20833807f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580087.385187:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580087.386009:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239731072 00000100:00100000:3.0:1787580087.386022:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239731072 00010000:00010000:3.0:1787580087.386087:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660200/0xc86deac208338040 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d28f expref: 6 pid: 8897 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580087.386139:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 63 00000100:00100000:3.0:1787580087.386150:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fad43127100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8d66e8ae-0b45-4a46-9f01-8e93d52be8ea+6:2360:x1874413239731072:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787580087.386167:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787580087.386174:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660200/0xc86deac208338040 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d28f expref: 6 pid: 8897 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580087.386189:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660200/0xc86deac208338040 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d28f expref: 6 pid: 8897 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580087.386213:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660200/0xc86deac208338040 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d28f expref: 6 pid: 8897 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580087.386231:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fae5bb2ff00) 00010000:00010000:3.0:1787580087.386237:0:5840:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50febe00/0xc86deac20833807f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580087.386247:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50febe00/0xc86deac20833807f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580087.386254:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50febe00/0xc86deac20833807f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580087.386293:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787580087.386353:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fad43127100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8d66e8ae-0b45-4a46-9f01-8e93d52be8ea+5:2360:x1874413239731072:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 206us (1176us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580087.386361:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 63 00010000:00010000:2.0:1787580087.386508:0:5853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50febe00/0xc86deac20833807f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.386517:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50febe00/0xc86deac20833807f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.386541:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8a00/0xc86deac208338086 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.386551:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8a00/0xc86deac208338086 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.386560:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8a00/0xc86deac208338086 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787580087.387689:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1787580087.387702:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50febe00/0xc86deac20833807f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.387711:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50febe00/0xc86deac20833807f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.387730:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50febe00/0xc86deac20833807f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.387736:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae50febe00 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:2.0:1787580087.387741:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50febe00/0xc86deac20833807f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.387749:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50febe00/0xc86deac20833807f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.387763:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fae5bb2ff00) 00010000:00010000:2.0:1787580087.387767:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787580087.387771:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50febe00/0xc86deac20833807f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.387778:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50febe00/0xc86deac20833807f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787580087.387796:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003b10096e reply state 000000006039f364 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8a00/0xc86deac208338086 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580087.387806:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787580087.387896:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fad43126a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+15:11402:x1874413239730944:12345-192.168.202.36@tcp:36:lfs.0 Request processed in 20225us (22094us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1787580087.387905:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 140 00000100:00080000:1.0:1787580087.388314:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787580087.390415:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8a00/0xc86deac208338086 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.390435:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8a00/0xc86deac208338086 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.390459:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8a00/0xc86deac208338086 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.390466:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db8a00 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:2.0:1787580087.390471:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8a00/0xc86deac208338086 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.390603:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8a00/0xc86deac208338086 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.390627:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8fae4c7d9c00) 00010000:00010000:2.0:1787580087.390631:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787580087.390636:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8a00/0xc86deac208338086 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.390700:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8a00/0xc86deac208338086 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580087.491027:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580087.491074:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239731200 00000100:00100000:2.0:1787580087.491084:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239731200 00000100:00100000:2.0:1787580087.491141:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 141 00000100:00100000:2.0:1787580087.491152:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7ec53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+14:11410:x1874413239731200:12345-192.168.202.36@tcp:101:lctl.0 00010000:00010000:2.0:1787580087.491177:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787580087.491200:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8a00/0xc86deac20833808d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d2a4 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.491265:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9a00/0xc86deac208338094 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.491290:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9a00/0xc86deac208338094 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.491303:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9a00/0xc86deac208338094 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787580087.491363:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787580087.491367:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1787580087.491411:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9a00/0xc86deac208338094 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.491436:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8a00/0xc86deac20833808d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d2a4 expref: 16 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.491453:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9a00/0xc86deac208338094 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d2a4 expref: 15 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.491461:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fae4c7d9c00) 00010000:00010000:2.0:1787580087.491464:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787580087.491467:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae48db9a00, rc 0) 00000100:00100000:2.0:1787580087.491525:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7ec53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+15:11410:x1874413239731200:12345-192.168.202.36@tcp:101:lctl.0 Request processed in 375us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580087.491533:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 141 00000100:00100000:1.0:1787580087.577648:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580087.577757:0:8897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239731328 00000100:00100000:2.0:1787580087.577768:0:8897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239731328 00000100:00100000:2.0:1787580087.577869:0:8897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 142 00000100:00100000:2.0:1787580087.577879:0:8897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fad43125880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+15:11416:x1874413239731328:12345-192.168.202.36@tcp:101:bash.0 00010000:00010000:2.0:1787580087.577900:0:8897:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787580087.577938:0:8897:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8a00/0xc86deac20833809b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d2ab expref: -99 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.578014:0:8897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac2083380a2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.578029:0:8897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac2083380a2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.578040:0:8897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac2083380a2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.578054:0:8897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac2083380a9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.578061:0:8897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac2083380a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.578067:0:8897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac2083380a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.578181:0:8897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8600/0xc86deac2083380b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.578190:0:8897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8600/0xc86deac2083380b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.578197:0:8897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8600/0xc86deac2083380b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787580087.578230:0:8897:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:2.0:1787580087.578234:0:8897:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787580087.578257:0:8897:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8600/0xc86deac2083380b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.578276:0:8897:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac2083380a2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.578282:0:8897:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac2083380a2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.578288:0:8897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac2083380a2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.578294:0:8897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db8200 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:2.0:1787580087.578297:0:8897:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac2083380a2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.578305:0:8897:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac2083380a2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.578317:0:8897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fae4c7d9c00) 00010000:00010000:2.0:1787580087.578320:0:8897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787580087.578324:0:8897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac2083380a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.578330:0:8897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac2083380a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.578345:0:8897:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac2083380a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.578352:0:8897:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac2083380a9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.578358:0:8897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac2083380a9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.578368:0:8897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db9c00 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:2.0:1787580087.578372:0:8897:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac2083380a9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.578377:0:8897:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac2083380a9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.578436:0:8897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8fae4c7d9500) 00010000:00010000:2.0:1787580087.578438:0:8897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787580087.578441:0:8897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac2083380a9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.578446:0:8897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac2083380a9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.578478:0:8897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8a00/0xc86deac20833809b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d2ab expref: 17 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.578490:0:8897:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8600/0xc86deac2083380b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d2ab expref: 16 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.578497:0:8897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8fae4c7d9800) 00010000:00010000:2.0:1787580087.578499:0:8897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787580087.578502:0:8897:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae48db8600, rc 0) 00000100:00100000:2.0:1787580087.578587:0:8897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fad43125880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+16:11416:x1874413239731328:12345-192.168.202.36@tcp:101:bash.0 Request processed in 707us (961us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580087.578595:0:8897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 142 00000100:00100000:2.0:1787580087.582274:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580087.582608:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239731584 00000100:00100000:0.0:1787580087.582620:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239731584 00000100:00100000:0.0:1787580087.583060:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 143 00000100:00100000:0.0:1787580087.583072:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7ec52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+16:11416:x1874413239731584:12345-192.168.202.36@tcp:101:bash.0 00010000:00010000:0.0:1787580087.583095:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787580087.583119:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feae00/0xc86deac2083380b7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d2b2 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580087.583264:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac2083380be lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580087.583282:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac2083380be lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580087.583306:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac2083380be lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580087.583365:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb200/0xc86deac2083380c5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580087.583374:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb200/0xc86deac2083380c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580087.583401:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb200/0xc86deac2083380c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787580087.583973:0:5854:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:0.0:1787580087.584132:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea000/0xc86deac2083380cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580087.584142:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea000/0xc86deac2083380cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580087.584150:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea000/0xc86deac2083380cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580087.584185:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac2083380be lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580087.584192:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac2083380be lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580087.584198:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac2083380be lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580087.584203:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae50feb600 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:0.0:1787580087.584213:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac2083380be lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580087.584220:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac2083380be lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580087.584232:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8fae4c7d9800) 00010000:00010000:0.0:1787580087.584235:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787580087.584240:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac2083380be lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580087.584245:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac2083380be lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787580087.584257:0:5854:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c2c40298 reply state 00000000ceeb4567 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb200/0xc86deac2083380c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580087.584266:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787580087.584296:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feae00/0xc86deac2083380b7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d2b2 expref: 19 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580087.584309:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea000/0xc86deac2083380cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d2b2 expref: 18 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580087.584316:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8fae56e35c00) 00010000:00010000:0.0:1787580087.584318:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787580087.584321:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae50fea000, rc 0) 00000100:00100000:0.0:1787580087.584617:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7ec52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+19:11416:x1874413239731584:12345-192.168.202.36@tcp:101:bash.0 Request processed in 1546us (2352us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1787580087.584626:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 143 00000100:00100000:2.0:1787580087.588311:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580087.588375:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239731712 00000100:00100000:3.0:1787580087.588410:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239731712 00000100:00100000:3.0:1787580087.588472:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 47 00000100:00100000:3.0:1787580087.588481:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7ec52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+5:2361:x1874413239731712:12345-192.168.202.36@tcp:101:bash.0 00010000:00010000:3.0:1787580087.588501:0:6705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787580087.588523:0:6705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a6998ca/0xc86deac2083380da lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d2b9 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787580087.588549:0:6705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787580087.588570:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=435s v=(0 0) 00010000:00010000:3.0:1787580087.588575:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787580087.588583:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a6998ca/0xc86deac2083380da lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d2b9 expref: 6 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580087.588601:0:6705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008a6998ca/0xc86deac2083380da lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d2b9 expref: 6 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580087.588615:0:6705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae5f6d6a00, rc 0) 00000100:00100000:3.0:1787580087.588672:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7ec52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:2361:x1874413239731712:12345-192.168.202.36@tcp:101:bash.0 Request processed in 192us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580087.588679:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 47 00000100:00080000:2.0:1787580087.588874:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787580087.591562:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580087.591647:0:10268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239731840 00000100:00100000:3.0:1787580087.591660:0:10268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239731840 00000100:00100000:3.0:1787580087.591725:0:10268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 48 00000100:00100000:3.0:1787580087.591746:0:10268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d5baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:11416:x1874413239731840:12345-192.168.202.36@tcp:101:bash.0 00010000:00010000:3.0:1787580087.591769:0:10268:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787580087.591796:0:10268:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080997781/0xc86deac2083380e1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d2c0 expref: -99 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580087.591847:0:10268:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008a6998ca/0xc86deac2083380da lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d2b9 expref: 7 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580087.591857:0:10268:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787580087.591862:0:10268:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787580087.591869:0:10268:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080997781/0xc86deac2083380e1 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d2c0 expref: 7 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580087.591911:0:10268:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008a6998ca/0xc86deac2083380da lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d2b9 expref: 7 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580087.591926:0:10268:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008a6998ca/0xc86deac2083380da lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d2b9 expref: 7 pid: 6705 timeout: 535 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580087.591944:0:10268:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae779ae680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10268:1874413262809344:192.168.202.36@tcp:104: 00000100:00100000:3.0:1787580087.592054:0:10268:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae6d67e240 going to sleep for 11 seconds 00010000:00010000:1.0:1787580087.593012:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb200/0xc86deac2083380c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580087.593023:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb200/0xc86deac2083380c5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580087.593030:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb200/0xc86deac2083380c5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580087.593036:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae50feb200 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:1.0:1787580087.593041:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb200/0xc86deac2083380c5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580087.593048:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb200/0xc86deac2083380c5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580087.593064:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8fae56e35800) 00010000:00010000:1.0:1787580087.593067:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787580087.593071:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb200/0xc86deac2083380c5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580087.593095:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb200/0xc86deac2083380c5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580087.595824:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580087.595967:0:10268:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae779ae680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10268:1874413262809344:192.168.202.36@tcp:104: 00010000:00010000:0.0:1787580087.596005:0:10268:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000080997781/0xc86deac2083380e1 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d2c0 expref: 7 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580087.596027:0:10268:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae5f6d6e00, rc 0) 00000100:00100000:0.0:1787580087.596098:0:10268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d5baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+7:11416:x1874413239731840:12345-192.168.202.36@tcp:101:bash.0 Request processed in 4355us (4546us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580087.596107:0:10268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 48 00000100:00100000:1.0:1787580087.596445:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239731968 00000100:00100000:1.0:1787580087.596453:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239731968 00010000:00010000:1.0:1787580087.596489:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008a6998ca/0xc86deac2083380da lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d2b9 expref: 7 pid: 6705 timeout: 535 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580087.596519:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 64 00000100:00100000:1.0:1787580087.596528:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+7:2360:x1874413239731968:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787580087.596542:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787580087.596564:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008a6998ca/0xc86deac2083380da lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d2b9 expref: 7 pid: 6705 timeout: 535 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580087.596575:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008a6998ca/0xc86deac2083380da lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d2b9 expref: 7 pid: 6705 timeout: 535 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580087.596596:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a6998ca/0xc86deac2083380da lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d2b9 expref: 7 pid: 6705 timeout: 535 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580087.596608:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787580087.596613:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787580087.596620:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000080997781/0xc86deac2083380e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d2c0 expref: 6 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580087.596630:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080997781/0xc86deac2083380e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d2c0 expref: 6 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580087.596689:0:5839:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000080997781/0xc86deac2083380e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d2c0 expref: 6 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580087.596703:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7f5bb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5839:1874413262809472:192.168.202.36@tcp:105: 00000100:00100000:1.0:1787580087.596768:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fad43647e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787580087.599716:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7f5bb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5839:1874413262809472:192.168.202.36@tcp:105: 00010000:00010000:1.0:1787580087.599759:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787580087.599830:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:2360:x1874413239731968:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 3302us (4024us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580087.599842:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 64 00000100:00100000:2.0:1787580087.602094:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580087.602263:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239732224 00000100:00100000:1.0:1787580087.602274:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239732224 00000100:00100000:1.0:1787580087.602371:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 36 00000100:00100000:1.0:1787580087.602407:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7ec51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+18:11416:x1874413239732224:12345-192.168.202.36@tcp:35:bash.0 00000100:00100000:1.0:1787580087.602768:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7ec51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+19:11416:x1874413239732224:12345-192.168.202.36@tcp:35:bash.0 Request processed in 388us (684us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1787580087.602777:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 36 00000100:00100000:2.0:1787580087.689334:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580087.689475:0:8897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239732480 00000100:00100000:1.0:1787580087.689488:0:8897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239732480 00000100:00100000:1.0:1787580087.689560:0:8897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 144 00000100:00100000:1.0:1787580087.689573:0:8897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d685500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+19:11426:x1874413239732480:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:1.0:1787580087.689598:0:8897:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787580087.689623:0:8897:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58200/0xc86deac2083380e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d2c7 expref: -99 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787580087.690034:0:8897:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1787580087.690174:0:8897:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58200/0xc86deac2083380e8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d2c7 expref: 21 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580087.690189:0:8897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fae4c7d9c00) 00010000:00010000:1.0:1787580087.690192:0:8897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787580087.690198:0:8897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58200/0xc86deac2083380e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d2c7 expref: 21 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580087.690212:0:8897:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae4ca58200, rc 0) 00000100:00100000:1.0:1787580087.690283:0:8897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d685500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+20:11426:x1874413239732480:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 712us (961us total) trans 4294967419 rc 301/301 00000100:00100000:1.0:1787580087.690291:0:8897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 144 00000100:00100000:3.0:1787580087.694257:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580087.694377:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239732736 00000100:00100000:2.0:1787580087.694422:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239732736 00000100:00100000:2.0:1787580087.694489:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 37 00000100:00100000:2.0:1787580087.694501:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+20:11426:x1874413239732736:12345-192.168.202.36@tcp:35:lfs.0 00000100:00100000:2.0:1787580087.695349:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+21:11426:x1874413239732736:12345-192.168.202.36@tcp:35:lfs.0 Request processed in 843us (1100us total) trans 4294967420 rc 0/0 00000100:00100000:2.0:1787580087.695361:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 37 00000100:00100000:2.0:1787580087.752759:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580087.752805:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580087.752894:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239732992 00000100:00100000:3.0:1787580087.752906:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239732992 00000100:00100000:3.0:1787580087.752969:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 49 00000100:00100000:3.0:1787580087.752979:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5f4adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:2358:x1874413239732992:12345-192.168.202.36@tcp:16:kworker.0 00000100:00100000:3.0:1787580087.753113:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5f4adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:2358:x1874413239732992:12345-192.168.202.36@tcp:16:kworker.0 Request processed in 135us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580087.753121:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 49 00000100:00100000:0.0:1787580087.753292:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239732864 00000100:00100000:0.0:1787580087.753297:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239732864 00002000:00100000:0.0:1787580087.753324:0:6713:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8fae5f4aca80 x1874413239732864/t0(0) o4->31d1df27-21ab-4c76-bd19-e53fa778bd7e@192.168.202.36@tcp:573/0 lens 504/0 e 0 to 0 dl 1787580098 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787580087.753335:0:6713:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8fae5f4aca80 with x1874413239732864 ext(0->12) 00002000:00010000:0.0:1787580087.753340:0:6713:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8fae5f4aca80 00000100:00100000:0.0:1787580087.753367:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 4 00000100:00100000:0.0:1787580087.753375:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5f4aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:2358:x1874413239732864:12345-192.168.202.36@tcp:4:bash.0 00000100:00100000:0.0:1787580087.753870:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5f4aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+8:2358:x1874413239732864:12345-192.168.202.36@tcp:4:bash.0 Request processed in 494us (1119us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1787580087.753878:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 4 00002000:00100000:0.0:1787580087.753885:0:6713:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8fae5f4aca80 x1874413239732864/t4294967305(0) o4->31d1df27-21ab-4c76-bd19-e53fa778bd7e@192.168.202.36@tcp:573/0 lens 504/448 e 0 to 0 dl 1787580098 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787580087.753893:0:6713:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8fae5f4aca80 with x1874413239732864 ext(0->12) 00002000:00010000:0.0:1787580087.753897:0:6713:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8fae5f4aca80 00000100:00100000:0.0:1787580087.792047:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580087.792218:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239733120 00000100:00100000:2.0:1787580087.792229:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239733120 00000100:00100000:2.0:1787580087.792294:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 145 00000100:00100000:2.0:1787580087.792305:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae504b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+21:11432:x1874413239733120:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:2.0:1787580087.792337:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787580087.792358:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8400/0xc86deac2083380f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d2ce expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.792468:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9800/0xc86deac2083380fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.792484:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9800/0xc86deac2083380fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.792494:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9800/0xc86deac2083380fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787580087.792561:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:2.0:1787580087.792565:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787580087.792587:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9800/0xc86deac2083380fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.792617:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8400/0xc86deac2083380f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d2ce expref: 23 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.792651:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9800/0xc86deac2083380fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d2ce expref: 22 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.792662:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8fae4c7d9800) 00010000:00010000:2.0:1787580087.792665:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787580087.792669:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae48db9800, rc 0) 00000100:00100000:2.0:1787580087.792748:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae504b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+22:11432:x1874413239733120:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 444us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580087.792756:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 145 00010000:00010000:1.0:1787580087.795979:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787580087.797708:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580087.797951:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239733376 00000100:00100000:0.0:1787580087.797963:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239733376 00000100:00100000:0.0:1787580087.798031:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 146 00000100:00100000:0.0:1787580087.798042:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5f4ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+22:11432:x1874413239733376:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:0.0:1787580087.798063:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787580087.798084:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac208338104 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d2d5 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580087.798192:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feac00/0xc86deac20833810b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580087.798208:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feac00/0xc86deac20833810b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580087.798217:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feac00/0xc86deac20833810b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787580087.798229:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787580087.798377:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac208338104 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d2d5 expref: 25 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580087.798422:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feac00/0xc86deac20833810b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d2d5 expref: 24 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580087.798431:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8fae56e35c00) 00010000:00010000:0.0:1787580087.798434:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787580087.798437:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae50feac00, rc 0) 00000100:00100000:0.0:1787580087.798508:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5f4ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+24:11432:x1874413239733376:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 468us (811us total) trans 4294967421 rc 0/0 00000100:00100000:0.0:1787580087.798536:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 146 00000100:00100000:3.0:1787580087.802713:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580087.802766:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580087.802850:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239733760 00000100:00100000:0.0:1787580087.802862:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239733760 00000100:00100000:0.0:1787580087.802931:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 10 00000100:00100000:0.0:1787580087.802942:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+24:2361:x1874413239733760:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787580087.802960:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787580087.802984:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feac00/0xc86deac20833810b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d2d5 expref: 24 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580087.803012:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8fae56e35c00) 00010000:00010000:0.0:1787580087.803017:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787580087.803070:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+23:2361:x1874413239733760:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 130us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580087.803078:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 10 00000100:00100000:2.0:1787580087.803609:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239733632 00000100:00100000:2.0:1787580087.803616:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239733632 00000100:00100000:2.0:1787580087.803658:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 147 00000100:00100000:2.0:1787580087.803667:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+23:11432:x1874413239733632:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:2.0:1787580087.803686:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787580087.803702:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8400/0xc86deac208338119 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d2dc expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.803819:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac208338120 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.803848:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac208338120 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.803859:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac208338120 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787580087.803872:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787580087.804189:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8400/0xc86deac208338119 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d2dc expref: 26 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.804206:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac208338120 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d2dc expref: 25 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.804213:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8fae56e35c00) 00010000:00010000:2.0:1787580087.804216:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787580087.804219:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae48db9e00, rc 0) 00000100:00100000:2.0:1787580087.804268:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+25:11432:x1874413239733632:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 602us (1565us total) trans 4294967422 rc 0/0 00000100:00100000:2.0:1787580087.804275:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 147 00000100:00100000:3.0:1787580087.809901:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580087.810007:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239733888 00000100:00100000:0.0:1787580087.810018:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239733888 00000100:00100000:0.0:1787580087.810089:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 50 00000100:00100000:0.0:1787580087.810101:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+8:2360:x1874413239733888:12345-192.168.202.36@tcp:1:lfs.0 00010000:00010000:0.0:1787580087.810148:0:6708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000057a71fc9/0xc86deac20833812e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580087.810168:0:6708:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000080997781/0xc86deac2083380e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d2c0 expref: 8 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580087.810178:0:6708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787580087.810182:0:6708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787580087.810202:0:6708:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000057a71fc9/0xc86deac20833812e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580087.810243:0:6708:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000080997781/0xc86deac2083380e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d2c0 expref: 8 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580087.810257:0:6708:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000080997781/0xc86deac2083380e1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d2c0 expref: 8 pid: 10268 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580087.810274:0:6708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae504b0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6708:1874413262809600:192.168.202.36@tcp:104: 00000100:00100000:0.0:1787580087.810371:0:6708:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae7eec2180 going to sleep for 11 seconds 00000100:00100000:0.0:1787580087.817822:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580087.817922:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239734016 00000100:00100000:1.0:1787580087.817934:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239734016 00010000:00010000:1.0:1787580087.817985:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000080997781/0xc86deac2083380e1 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d2c0 expref: 9 pid: 10268 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580087.818036:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 65 00000100:00100000:1.0:1787580087.818047:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48d84850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+9:2361:x1874413239734016:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787580087.818063:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787580087.818081:0:5839:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1787580087.818084:0:5839:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787580087 00002000:00010000:1.0:1787580087.818087:0:5839:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1787580087 00010000:00010000:1.0:1787580087.818110:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000080997781/0xc86deac2083380e1 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d2c0 expref: 9 pid: 10268 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580087.818124:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000080997781/0xc86deac2083380e1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d2c0 expref: 9 pid: 10268 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580087.818149:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787580087.818153:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787580087.818159:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000057a71fc9/0xc86deac20833812e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580087.818168:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000057a71fc9/0xc86deac20833812e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580087.818186:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787580087.818240:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48d84850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+9:2361:x1874413239734016:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 195us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580087.818247:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 65 00010000:00010000:2.0:1787580087.818443:0:6708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080997781/0xc86deac2083380e1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d2c0 expref: 8 pid: 10268 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580087.818459:0:6708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae504b0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6708:1874413262809600:192.168.202.36@tcp:104: 00010000:00010000:2.0:1787580087.818480:0:6708:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000057a71fc9/0xc86deac20833812e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.818492:0:6708:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000057a71fc9/0xc86deac20833812e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.818507:0:6708:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000057a71fc9/0xc86deac20833812e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.818533:0:6708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000057a71fc9/0xc86deac20833812e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.818542:0:6708:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000057a71fc9/0xc86deac20833812e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.818550:0:6708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000057a71fc9/0xc86deac20833812e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.818558:0:6708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae50feac00 already unused, calling callback (ffffffffc155a230) 00010000:00010000:2.0:1787580087.818563:0:6708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000057a71fc9/0xc86deac20833812e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.818572:0:6708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000057a71fc9/0xc86deac20833812e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.818584:0:6708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000057a71fc9/0xc86deac20833812e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.818592:0:6708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000057a71fc9/0xc86deac20833812e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580087.818647:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+7:2360:x1874413239733888:12345-192.168.202.36@tcp:1:lfs.0 Request processed in 8550us (8761us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580087.818656:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 50 00000100:00100000:2.0:1787580087.821781:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580087.821923:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239734272 00000100:00100000:1.0:1787580087.821934:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239734272 00000100:00100000:1.0:1787580087.821992:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 38 00000100:00100000:1.0:1787580087.822009:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51884850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+25:11432:x1874413239734272:12345-192.168.202.36@tcp:35:lfs.0 00000004:00010000:1.0:1787580087.822078:0:5855:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac208338120 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d2dc expref: 25 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787580087.822326:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:1.0:1787580087.822366:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:1.0:1787580087.822908:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:1.0:1787580087.822960:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58200/0xc86deac208338135 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580087.822980:0:5855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea000/0xc86deac2083380cc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d2b2 expref: 29 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580087.822989:0:5855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58200/0xc86deac208338135 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580087.823030:0:5855:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea000/0xc86deac2083380cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d2b2 expref: 29 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580087.823048:0:5855:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea000/0xc86deac2083380cc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d2b2 expref: 29 pid: 5854 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580087.823065:0:5855:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7f5bb480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5855:1874413262809728:192.168.202.36@tcp:104: 00000100:00100000:1.0:1787580087.823158:0:5855:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fad43647600 going to sleep for 11 seconds 00000100:00100000:3.0:1787580087.827184:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580087.827353:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239734400 00000100:00100000:0.0:1787580087.827365:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239734400 00010000:00010000:0.0:1787580087.827455:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea000/0xc86deac2083380cc lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d2b2 expref: 30 pid: 5854 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580087.827506:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 66 00000100:00100000:0.0:1787580087.827518:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+30:2361:x1874413239734400:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787580087.827537:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787580087.827545:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea000/0xc86deac2083380cc lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d2b2 expref: 30 pid: 5854 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580087.827560:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea000/0xc86deac2083380cc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d2b2 expref: 30 pid: 5854 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580087.827587:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8fae56e35c00) 00010000:00010000:0.0:1787580087.827610:0:5840:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58200/0xc86deac208338135 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580087.827623:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58200/0xc86deac208338135 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580087.827631:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58200/0xc86deac208338135 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580087.827664:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787580087.827715:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+30:2361:x1874413239734400:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 199us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580087.827724:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 66 00010000:00010000:1.0:1787580087.828784:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea000/0xc86deac2083380cc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d2b2 expref: 29 pid: 5854 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580087.828805:0:5855:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7f5bb480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5855:1874413262809728:192.168.202.36@tcp:104: 00010000:00010000:1.0:1787580087.828841:0:5855:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58200/0xc86deac208338135 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580087.828851:0:5855:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58200/0xc86deac208338135 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580087.828857:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58200/0xc86deac208338135 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787580087.828991:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:1.0:1787580087.829198:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:1.0:1787580087.829303:0:5855:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7f5bb480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5855:1874413262809856:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787580087.829361:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787580087.829446:0:5855:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fad43647180 going to sleep for 11 seconds 00000100:00100000:0.0:1787580087.829881:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262809856 00000100:00100000:0.0:1787580087.829888:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262809856 00000100:00100000:0.0:1787580087.829948:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787580087.829958:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7f5b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5855:x1874413262809856:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787580087.830038:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7f5b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5855:x1874413262809856:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 82us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580087.830046:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1787580087.830285:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787580087.830316:0:5855:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7f5bb480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5855:1874413262809856:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787580087.831154:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:1.0:1787580087.831227:0:5855:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7f5bb480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5855:1874413262809984:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787580087.831269:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787580087.831292:0:5855:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fad43647600 going to sleep for 11 seconds 00000100:00100000:0.0:1787580087.831443:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262809984 00000100:00100000:0.0:1787580087.831449:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262809984 00000100:00100000:0.0:1787580087.831495:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787580087.831503:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7f5b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5855:x1874413262809984:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787580087.831940:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7f5b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5855:x1874413262809984:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 436us (669us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1787580087.831949:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787580087.832251:0:5855:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7f5bb480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5855:1874413262809984:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787580087.832312:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:1.0:1787580087.832358:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58200/0xc86deac208338135 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580087.832370:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58200/0xc86deac208338135 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580087.832378:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58200/0xc86deac208338135 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580087.832416:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae4ca58200 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:1.0:1787580087.832421:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58200/0xc86deac208338135 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580087.832429:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58200/0xc86deac208338135 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580087.832458:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8fae56e35c00) 00010000:00010000:1.0:1787580087.832460:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787580087.832465:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58200/0xc86deac208338135 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580087.832472:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58200/0xc86deac208338135 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787580087.832662:0:5855:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787580087.832779:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:1.0:1787580087.832790:0:5855:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 435588406075ns, next at 436588403993ns, rc = 0 00000001:00080000:1.0:1787580087.832796:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:1.0:1787580087.832840:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8fae56e35c00) 00010000:00010000:1.0:1787580087.832843:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787580087.832850:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac208338120 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d2dc expref: 33 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580087.832939:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51884850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+32:11432:x1874413239734272:12345-192.168.202.36@tcp:35:lfs.0 Request processed in 10931us (11175us total) trans 4294967431 rc 0/0 00000100:00100000:1.0:1787580087.832948:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 38 00000020:00080000:1.0:1787580087.832952:0:5855:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1787580087.835506:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580087.835769:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239734528 00000100:00100000:0.0:1787580087.835779:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239734528 00000100:00100000:0.0:1787580087.835861:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 148 00000100:00100000:0.0:1787580087.835871:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+32:11432:x1874413239734528:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:0.0:1787580087.835895:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787580087.835917:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feaa00/0xc86deac20833813c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d2e3 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580087.835975:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feaa00/0xc86deac20833813c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d2e3 expref: 33 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580087.835989:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feaa00/0xc86deac20833813c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d2e3 expref: 33 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580087.836239:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8fae56e35e00) 00010000:00010000:0.0:1787580087.836243:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787580087.836247:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae50feaa00, rc 0) 00000100:00100000:0.0:1787580087.836316:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+33:11432:x1874413239734528:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 445us (819us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580087.836324:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 148 00000100:00100000:0.0:1787580087.839030:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580087.839177:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239734784 00000100:00100000:2.0:1787580087.839186:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239734784 00000100:00100000:2.0:1787580087.839241:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 39 00000100:00100000:2.0:1787580087.839251:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae504b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+33:11432:x1874413239734784:12345-192.168.202.36@tcp:35:lfs.0 00000100:00100000:2.0:1787580087.839648:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae504b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+34:11432:x1874413239734784:12345-192.168.202.36@tcp:35:lfs.0 Request processed in 398us (626us total) trans 4294967432 rc 0/0 00000100:00100000:2.0:1787580087.839657:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 39 00000100:00100000:2.0:1787580087.920051:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580087.920112:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239735040 00000100:00100000:0.0:1787580087.920123:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239735040 00000100:00100000:0.0:1787580087.920229:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 149 00000100:00100000:0.0:1787580087.920242:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7463aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+34:11442:x1874413239735040:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:0.0:1787580087.920271:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787580087.920294:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea800/0xc86deac208338143 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d2ea expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787580087.920481:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1787580087.920618:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea800/0xc86deac208338143 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d2ea expref: 36 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580087.920633:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fae4c7d9c00) 00010000:00010000:0.0:1787580087.920636:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787580087.920641:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea800/0xc86deac208338143 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d2ea expref: 36 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580087.920655:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae50fea800, rc 0) 00000100:00100000:0.0:1787580087.920712:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7463aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+35:11442:x1874413239735040:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 473us (668us total) trans 4294967433 rc 301/301 00000100:00100000:0.0:1787580087.920719:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 149 00000100:00100000:3.0:1787580087.922899:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580087.922953:0:8897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239735168 00000100:00100000:1.0:1787580087.922964:0:8897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239735168 00000100:00100000:3.0:1787580087.923151:0:8897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 150 00000100:00100000:3.0:1787580087.923161:0:8897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+35:11442:x1874413239735168:12345-192.168.202.36@tcp:34:lfs.0 00010000:00010000:3.0:1787580087.923250:0:8897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7000/0xc86deac208338151 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580087.923273:0:8897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7000/0xc86deac208338151 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580087.923287:0:8897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7000/0xc86deac208338151 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580087.923305:0:8897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6e00/0xc86deac208338158 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580087.923313:0:8897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6e00/0xc86deac208338158 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580087.923337:0:8897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6e00/0xc86deac208338158 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580087.923524:0:8897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6a00/0xc86deac20833815f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580087.923534:0:8897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6a00/0xc86deac20833815f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580087.923540:0:8897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6a00/0xc86deac20833815f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787580087.923589:0:8897:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6a00/0xc86deac20833815f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580087.923603:0:8897:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7000/0xc86deac208338151 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580087.923610:0:8897:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7000/0xc86deac208338151 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580087.923617:0:8897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7000/0xc86deac208338151 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580087.923624:0:8897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae5f6d7000 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:3.0:1787580087.923628:0:8897:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7000/0xc86deac208338151 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580087.923635:0:8897:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7000/0xc86deac208338151 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580087.923647:0:8897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8fae4c7d9800) 00010000:00010000:3.0:1787580087.923656:0:8897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787580087.923661:0:8897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7000/0xc86deac208338151 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580087.923667:0:8897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7000/0xc86deac208338151 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580087.923681:0:8897:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6e00/0xc86deac208338158 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580087.923688:0:8897:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6e00/0xc86deac208338158 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580087.923693:0:8897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6e00/0xc86deac208338158 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580087.923698:0:8897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae5f6d6e00 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:3.0:1787580087.923701:0:8897:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6e00/0xc86deac208338158 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580087.923707:0:8897:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6e00/0xc86deac208338158 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580087.923715:0:8897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8fae530b1200) 00010000:00010000:3.0:1787580087.923717:0:8897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787580087.923720:0:8897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6e00/0xc86deac208338158 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580087.924060:0:8897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6e00/0xc86deac208338158 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580087.924081:0:8897:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6a00/0xc86deac20833815f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580087.924094:0:8897:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6a00/0xc86deac20833815f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580087.924101:0:8897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6a00/0xc86deac20833815f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580087.924107:0:8897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae5f6d6a00 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:3.0:1787580087.924111:0:8897:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6a00/0xc86deac20833815f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580087.924117:0:8897:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6a00/0xc86deac20833815f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580087.924126:0:8897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8fae56e35e00) 00010000:00010000:3.0:1787580087.924128:0:8897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787580087.924132:0:8897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6a00/0xc86deac20833815f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580087.924137:0:8897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6a00/0xc86deac20833815f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580087.924236:0:8897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+35:11442:x1874413239735168:12345-192.168.202.36@tcp:34:lfs.0 Request processed in 1072us (1346us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580087.924245:0:8897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 150 00000100:00100000:1.0:1787580087.927449:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580087.927586:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239735424 00000100:00100000:3.0:1787580087.927596:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239735424 00000100:00100000:3.0:1787580087.927664:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 40 00000100:00100000:3.0:1787580087.927674:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7f5bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+35:11442:x1874413239735424:12345-192.168.202.36@tcp:35:lfs.0 00000100:00100000:3.0:1787580087.928563:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7f5bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+36:11442:x1874413239735424:12345-192.168.202.36@tcp:35:lfs.0 Request processed in 886us (1121us total) trans 4294967434 rc 0/0 00000100:00100000:3.0:1787580087.928587:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 40 00000100:00100000:1.0:1787580087.971662:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580087.971770:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239735680 00000100:00100000:2.0:1787580087.971780:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239735680 00000100:00100000:2.0:1787580087.971865:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 151 00000100:00100000:2.0:1787580087.971878:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7f5bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+36:11445:x1874413239735680:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:2.0:1787580087.971911:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787580087.971935:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208338166 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d2f1 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.972016:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8a00/0xc86deac20833816d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.972032:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8a00/0xc86deac20833816d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.972064:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8a00/0xc86deac20833816d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.972079:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac208338174 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.972086:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac208338174 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.972093:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac208338174 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.972230:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac20833817b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.972239:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac20833817b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.972246:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac20833817b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787580087.972257:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787580087.972365:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8a00/0xc86deac20833816d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.972374:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8a00/0xc86deac20833816d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.972429:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8a00/0xc86deac20833816d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.972437:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db8a00 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:2.0:1787580087.972448:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8a00/0xc86deac20833816d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.972457:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8a00/0xc86deac20833816d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.972471:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8fae4c7d9800) 00010000:00010000:2.0:1787580087.972474:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787580087.972479:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8a00/0xc86deac20833816d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.972486:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8a00/0xc86deac20833816d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.972501:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac208338174 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.972507:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac208338174 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.972514:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac208338174 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.972520:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db8200 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:2.0:1787580087.972523:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac208338174 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.972530:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac208338174 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.972537:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8fae4c7d9500) 00010000:00010000:2.0:1787580087.972539:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787580087.972547:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac208338174 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.972554:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac208338174 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.972601:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208338166 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d2f1 expref: 39 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.972615:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac20833817b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d2f1 expref: 38 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.972623:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8fae56e35e00) 00010000:00010000:2.0:1787580087.972626:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787580087.972629:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae48db8800, rc 0) 00000100:00100000:2.0:1787580087.972681:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7f5bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+38:11445:x1874413239735680:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 806us (1030us total) trans 4294967435 rc 0/0 00000100:00100000:2.0:1787580087.972689:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 151 00000100:00100000:0.0:1787580087.977010:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580087.977098:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239735808 00000100:00100000:2.0:1787580087.977109:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239735808 00000100:00100000:2.0:1787580087.977178:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 152 00000100:00100000:2.0:1787580087.977189:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae504b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+38:11445:x1874413239735808:12345-192.168.202.36@tcp:54:lfs.0 00010000:00010000:2.0:1787580087.977269:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac208338189 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.977288:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac208338189 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.977299:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac208338189 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.977345:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac208338189 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.977354:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac208338189 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.977361:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac208338189 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.977368:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db9e00 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:2.0:1787580087.977372:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac208338189 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.977380:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac208338189 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.977437:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8fae56e35e00) 00010000:00010000:2.0:1787580087.977440:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787580087.977444:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac208338189 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580087.977451:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac208338189 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580087.977531:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae504b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+38:11445:x1874413239735808:12345-192.168.202.36@tcp:54:lfs.0 Request processed in 344us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580087.977539:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 152 00000100:00100000:1.0:1787580087.980432:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580087.980524:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239736064 00000100:00100000:0.0:1787580087.980535:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239736064 00000100:00100000:0.0:1787580087.980591:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 41 00000100:00100000:0.0:1787580087.980601:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7f5b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+38:11445:x1874413239736064:12345-192.168.202.36@tcp:35:lfs.0 00000100:00100000:0.0:1787580087.980862:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7f5b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+39:11445:x1874413239736064:12345-192.168.202.36@tcp:35:lfs.0 Request processed in 261us (486us total) trans 4294967436 rc 0/0 00000100:00100000:0.0:1787580087.980871:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 41 00000100:00100000:1.0:1787580088.211590:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580088.211719:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239736320 00000100:00100000:2.0:1787580088.211729:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239736320 00000100:00100000:2.0:1787580088.211798:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 153 00000100:00100000:2.0:1787580088.211851:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7f5bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+39:11476:x1874413239736320:12345-192.168.202.36@tcp:101:cat.0 00010000:00010000:2.0:1787580088.211877:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787580088.211900:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac208338190 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d2f8 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580088.212002:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208338197 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580088.212017:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208338197 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580088.212026:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208338197 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787580088.212036:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787580088.212177:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac208338190 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d2f8 expref: 42 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580088.212194:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208338197 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d2f8 expref: 41 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580088.212202:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8fae56e35e00) 00010000:00010000:2.0:1787580088.212205:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787580088.212208:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae48db9c00, rc 0) 00000100:00100000:2.0:1787580088.212721:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7f5bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+41:11476:x1874413239736320:12345-192.168.202.36@tcp:101:cat.0 Request processed in 871us (1141us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1787580088.212729:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 153 00000100:00100000:1.0:1787580088.217487:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580088.217553:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580088.217821:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239736576 00000100:00100000:0.0:1787580088.217831:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239736576 00000100:00100000:0.0:1787580088.217891:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 42 00000100:00100000:0.0:1787580088.217902:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7ec50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+41:11476:x1874413239736576:12345-192.168.202.36@tcp:35:cat.0 00000100:00100000:2.0:1787580088.217985:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239736704 00000100:00100000:2.0:1787580088.218000:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239736704 00000100:00100000:2.0:1787580088.218064:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 11 00000100:00100000:2.0:1787580088.218073:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7ec51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+43:2358:x1874413239736704:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787580088.218092:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787580088.218123:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208338197 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d2f8 expref: 43 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580088.218143:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8fae56e35e00) 00010000:00010000:2.0:1787580088.218148:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787580088.218298:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7ec50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+42:11476:x1874413239736576:12345-192.168.202.36@tcp:35:cat.0 Request processed in 397us (823us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1787580088.218306:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 42 00000100:00100000:2.0:1787580088.222965:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7ec51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+41:2358:x1874413239736704:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 4880us (5397us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580088.222981:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 11 00000100:00100000:1.0:1787580088.295215:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580088.295316:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239736960 00000100:00100000:2.0:1787580088.295326:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239736960 00000100:00100000:2.0:1787580088.295433:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 154 00000100:00100000:2.0:1787580088.295444:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7ec50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+41:11482:x1874413239736960:12345-192.168.202.36@tcp:101:dd.0 00010000:00010000:2.0:1787580088.295472:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787580088.295475:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787580088.295505:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9800/0xc86deac2083380fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d2ce expref: 41 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580088.295524:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8fae4c7d9800) 00010000:00010000:2.0:1787580088.295529:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787580088.295543:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac2083381a5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d2ff expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580088.295983:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac2083381ac lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580088.296020:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac20833817b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d2f1 expref: 41 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580088.296029:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac2083381ac lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580088.296062:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac20833817b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d2f1 expref: 41 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580088.296078:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac20833817b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d2f1 expref: 41 pid: 5852 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580088.296093:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae74639880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5854:1874413262810112:192.168.202.36@tcp:104: 00000100:00100000:2.0:1787580088.296242:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae54f5cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787580088.316715:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580088.317230:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239737088 00000100:00100000:3.0:1787580088.317241:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239737088 00010000:00010000:3.0:1787580088.317284:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac20833817b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d2f1 expref: 42 pid: 5852 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580088.317330:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 67 00000100:00100000:3.0:1787580088.317342:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d684700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+42:2360:x1874413239737088:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787580088.317360:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787580088.317368:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac20833817b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d2f1 expref: 42 pid: 5852 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580088.317420:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac20833817b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d2f1 expref: 42 pid: 5852 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580088.317447:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8fae56e35e00) 00010000:00010000:3.0:1787580088.317453:0:5839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac2083381ac lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580088.317464:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac2083381ac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580088.317471:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac2083381ac lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580088.317490:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787580088.317551:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d684700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+42:2360:x1874413239737088:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 212us (846us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580088.317573:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 67 00010000:00010000:3.0:1787580088.317613:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac20833817b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d2f1 expref: 41 pid: 5852 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580088.317625:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae74639880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5854:1874413262810112:192.168.202.36@tcp:104: 00010000:00010000:3.0:1787580088.317655:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac2083381ac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580088.317662:0:5854:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac2083381ac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580088.317666:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac2083381ac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787580088.317684:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1787580088.317864:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac2083381a5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d2ff expref: 42 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580088.317878:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac2083381ac lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d2ff expref: 41 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580088.317885:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8fae56e35e00) 00010000:00010000:3.0:1787580088.317888:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787580088.317890:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae48db9e00, rc 0) 00000100:00100000:3.0:1787580088.317918:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7ec50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+41:11482:x1874413239736960:12345-192.168.202.36@tcp:101:dd.0 Request processed in 22477us (22715us total) trans 4294967439 rc 0/0 00000100:00100000:3.0:1787580088.317925:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 154 00000100:00100000:3.0:1787580088.320275:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580088.320684:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239737344 00000100:00100000:2.0:1787580088.320696:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239737344 00000100:00100000:2.0:1787580088.320928:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 155 00000100:00100000:2.0:1787580088.320941:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+41:11482:x1874413239737344:12345-192.168.202.36@tcp:36:dd.0 00010000:00010000:2.0:1787580088.321232:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8a00/0xc86deac2083381ba lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580088.321251:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8a00/0xc86deac2083381ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580088.321264:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8a00/0xc86deac2083381ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787580088.321319:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:2.0:1787580088.321366:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002abee6a0 reply state 000000000abe3b73 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8a00/0xc86deac2083381ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580088.321375:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787580088.321736:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+44:11482:x1874413239737344:12345-192.168.202.36@tcp:36:dd.0 Request processed in 789us (1461us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1787580088.321745:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 155 00000020:00080000:2.0:1787580088.321750:0:5852:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787580088.329548:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8a00/0xc86deac2083381ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580088.329569:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8a00/0xc86deac2083381ba lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580088.329577:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8a00/0xc86deac2083381ba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580088.329584:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db8a00 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:0.0:1787580088.329589:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8a00/0xc86deac2083381ba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580088.329598:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8a00/0xc86deac2083381ba lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580088.329619:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8fae56e35e00) 00010000:00010000:0.0:1787580088.329622:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787580088.329637:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8a00/0xc86deac2083381ba lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580088.329644:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8a00/0xc86deac2083381ba lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787580088.522219:0:6733:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000001:00080000:0.0:1787580088.522237:0:6733:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000100:00100000:3.0:1787580088.575721:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580088.576053:0:8897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239737472 00000100:00100000:2.0:1787580088.576065:0:8897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239737472 00000100:00100000:2.0:1787580088.576128:0:8897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 156 00000100:00100000:2.0:1787580088.576138:0:8897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+43:11496:x1874413239737472:12345-192.168.202.36@tcp:101:stat.0 00010000:00010000:2.0:1787580088.576168:0:8897:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787580088.576191:0:8897:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9800/0xc86deac2083381c1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d306 expref: -99 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580088.576270:0:8897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac2083381c8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580088.576287:0:8897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac2083381c8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580088.576298:0:8897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac2083381c8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580088.576312:0:8897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8400/0xc86deac2083381cf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580088.576319:0:8897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8400/0xc86deac2083381cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580088.576340:0:8897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8400/0xc86deac2083381cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580088.576495:0:8897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9400/0xc86deac2083381d6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580088.576507:0:8897:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac2083381ac lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d2ff expref: 44 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580088.576515:0:8897:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9400/0xc86deac2083381d6 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580088.576551:0:8897:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac2083381ac lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d2ff expref: 44 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580088.576565:0:8897:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac2083381ac lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d2ff expref: 44 pid: 5854 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580088.576581:0:8897:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae74638000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8897:1874413262810240:192.168.202.36@tcp:104: 00000100:00100000:2.0:1787580088.576812:0:8897:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae43dfc900 going to sleep for 11 seconds 00000100:00100000:2.0:1787580088.580081:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580088.580183:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239737728 00000100:00100000:0.0:1787580088.580192:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239737728 00000100:00100000:0.0:1787580088.580268:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 43 00000100:00100000:0.0:1787580088.580280:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7463bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+45:5600:x1874413239737728:12345-192.168.202.36@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787580088.580678:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7463bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+46:5600:x1874413239737728:12345-192.168.202.36@tcp:35:ldlm_bl.0 Request processed in 398us (607us total) trans 4294967442 rc 0/0 00000100:00100000:0.0:1787580088.580686:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 43 00000100:00100000:3.0:1787580088.582986:0:8897:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae74638000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8897:1874413262810240:192.168.202.36@tcp:104: 00010000:00010000:3.0:1787580088.583017:0:8897:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9400/0xc86deac2083381d6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580088.583194:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580088.583503:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239737856 00000100:00100000:2.0:1787580088.583511:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239737856 00010000:00010000:2.0:1787580088.583549:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac2083381ac lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d2ff expref: 46 pid: 5854 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580088.583587:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 68 00000100:00100000:2.0:1787580088.583597:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d687480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+46:2361:x1874413239737856:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787580088.583893:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787580088.583903:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac2083381ac lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d2ff expref: 46 pid: 5854 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580088.583917:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac2083381ac lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d2ff expref: 46 pid: 5854 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580088.583939:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac2083381ac lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d2ff expref: 46 pid: 5854 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580088.583956:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8fae56e35e00) 00010000:00010000:2.0:1787580088.583961:0:5838:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9400/0xc86deac2083381d6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580088.583973:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9400/0xc86deac2083381d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580088.583981:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9400/0xc86deac2083381d6 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580088.584117:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787580088.584181:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d687480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+45:2361:x1874413239737856:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 584us (986us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580088.584190:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 68 00010000:00010000:3.0:1787580088.585323:0:8897:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9400/0xc86deac2083381d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580088.585337:0:8897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9400/0xc86deac2083381d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787580088.585448:0:8897:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1787580088.585453:0:8897:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787580088.585487:0:8897:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9400/0xc86deac2083381d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580088.585505:0:8897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9400/0xc86deac2083381d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580088.585516:0:8897:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac2083381c8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580088.585523:0:8897:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac2083381c8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580088.585531:0:8897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac2083381c8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580088.585537:0:8897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db9000 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:3.0:1787580088.585542:0:8897:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac2083381c8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580088.585569:0:8897:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac2083381c8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580088.585583:0:8897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8fae4c7d9800) 00010000:00010000:3.0:1787580088.585586:0:8897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787580088.585591:0:8897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac2083381c8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580088.585598:0:8897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac2083381c8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580088.585613:0:8897:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8400/0xc86deac2083381cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580088.585619:0:8897:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8400/0xc86deac2083381cf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580088.585687:0:8897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8400/0xc86deac2083381cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580088.585693:0:8897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db8400 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:3.0:1787580088.585696:0:8897:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8400/0xc86deac2083381cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580088.585703:0:8897:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8400/0xc86deac2083381cf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580088.585712:0:8897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8fae4c7d9500) 00010000:00010000:3.0:1787580088.585716:0:8897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787580088.585719:0:8897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8400/0xc86deac2083381cf lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580088.586130:0:8897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8400/0xc86deac2083381cf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580088.586180:0:8897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9800/0xc86deac2083381c1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d306 expref: 45 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580088.586196:0:8897:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9400/0xc86deac2083381d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d306 expref: 44 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580088.586203:0:8897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8fae56e35e00) 00010000:00010000:3.0:1787580088.586206:0:8897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787580088.586208:0:8897:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae48db9400, rc 0) 00000100:00100000:3.0:1787580088.586557:0:8897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+44:11496:x1874413239737472:12345-192.168.202.36@tcp:101:stat.0 Request processed in 10417us (10843us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580088.586568:0:8897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 156 00000100:00100000:1.0:1787580088.664907:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580088.665008:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239738112 00000100:00100000:0.0:1787580088.665018:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239738112 00000100:00100000:0.0:1787580088.665123:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 157 00000100:00100000:0.0:1787580088.665134:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d684000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+44:11502:x1874413239738112:12345-192.168.202.36@tcp:36:truncate.0 00010000:00010000:0.0:1787580088.665201:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787580088.665229:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9400/0xc86deac2083381d6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d306 expref: 44 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580088.665249:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8fae56e35e00) 00010000:00010000:0.0:1787580088.665254:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787580088.665538:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac2083381dd lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580088.665554:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac2083381dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580088.665564:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac2083381dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787580088.665707:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:0.0:1787580088.665898:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f3a30275 reply state 000000005d3ec167 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac2083381dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580088.665910:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787580088.666146:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d684000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+46:11502:x1874413239738112:12345-192.168.202.36@tcp:36:truncate.0 Request processed in 1013us (1248us total) trans 4294967444 rc 0/0 00000100:00100000:0.0:1787580088.666154:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 157 00000020:00080000:0.0:1787580088.666159:0:5853:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787580088.680050:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac2083381dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580088.680069:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac2083381dd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580088.680077:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac2083381dd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580088.680083:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae50feb600 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:1.0:1787580088.680089:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac2083381dd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580088.680097:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac2083381dd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580088.680118:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8fae56e35e00) 00010000:00010000:1.0:1787580088.680121:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787580088.680125:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac2083381dd lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580088.680132:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac2083381dd lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580088.811336:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580088.812342:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239738240 00000100:00100000:3.0:1787580088.812356:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239738240 00000100:00100000:3.0:1787580088.812514:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 158 00000100:00100000:3.0:1787580088.812525:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7efda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+45:11516:x1874413239738240:12345-192.168.202.36@tcp:101:stat.0 00010000:00010000:3.0:1787580088.812558:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787580088.812587:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6a00/0xc86deac2083381e4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d30d expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580088.812791:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6e00/0xc86deac2083381eb lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580088.812814:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6e00/0xc86deac2083381eb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580088.812839:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6e00/0xc86deac2083381eb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580088.812856:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7000/0xc86deac2083381f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580088.812863:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7000/0xc86deac2083381f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580088.812870:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7000/0xc86deac2083381f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580088.812977:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7800/0xc86deac2083381f9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580088.812987:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7800/0xc86deac2083381f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580088.812994:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7800/0xc86deac2083381f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787580088.813031:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:3.0:1787580088.813036:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787580088.813055:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7800/0xc86deac2083381f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580088.813066:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7800/0xc86deac2083381f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580088.813074:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6e00/0xc86deac2083381eb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580088.813090:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6e00/0xc86deac2083381eb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580088.813097:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6e00/0xc86deac2083381eb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580088.813103:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae5f6d6e00 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:3.0:1787580088.813107:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6e00/0xc86deac2083381eb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580088.813114:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6e00/0xc86deac2083381eb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580088.813125:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8fae4c7d9800) 00010000:00010000:3.0:1787580088.813128:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787580088.813133:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6e00/0xc86deac2083381eb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580088.813139:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6e00/0xc86deac2083381eb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580088.813154:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7000/0xc86deac2083381f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580088.813160:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7000/0xc86deac2083381f2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580088.813166:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7000/0xc86deac2083381f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580088.813172:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae5f6d7000 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:3.0:1787580088.813181:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7000/0xc86deac2083381f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580088.813186:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7000/0xc86deac2083381f2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580088.813194:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8fae530b1c00) 00010000:00010000:3.0:1787580088.813197:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787580088.813200:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7000/0xc86deac2083381f2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580088.813205:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7000/0xc86deac2083381f2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580088.813237:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6a00/0xc86deac2083381e4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d30d expref: 47 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580088.813250:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7800/0xc86deac2083381f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d30d expref: 46 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580088.813258:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8fae56e35e00) 00010000:00010000:3.0:1787580088.813260:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787580088.813263:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae5f6d7800, rc 0) 00000100:00100000:3.0:1787580088.813433:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7efda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+46:11516:x1874413239738240:12345-192.168.202.36@tcp:101:stat.0 Request processed in 910us (2108us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580088.813441:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 158 00010000:00010000:0.0:1787580088.819541:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787580088.887084:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580088.887199:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239738496 00000100:00100000:2.0:1787580088.887211:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239738496 00000100:00100000:2.0:1787580088.887286:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 159 00000100:00100000:2.0:1787580088.887298:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae504b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+46:11526:x1874413239738496:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:2.0:1787580088.887323:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787580088.887347:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac208338200 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d314 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787580088.887535:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1787580088.887693:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac208338200 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d314 expref: 48 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580088.887710:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fae4c7d9c00) 00010000:00010000:2.0:1787580088.887713:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787580088.887719:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac208338200 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d314 expref: 48 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580088.887735:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae48db9e00, rc 0) 00000100:00100000:2.0:1787580088.887813:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae504b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+47:11526:x1874413239738496:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 516us (739us total) trans 4294967445 rc 301/301 00000100:00100000:2.0:1787580088.887821:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 159 00000100:00100000:0.0:1787580088.891519:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580088.891606:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239738752 00000100:00100000:3.0:1787580088.891616:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239738752 00000100:00100000:3.0:1787580088.891684:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 44 00000100:00100000:3.0:1787580088.891694:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51886050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+47:11526:x1874413239738752:12345-192.168.202.36@tcp:35:lfs.0 00000100:00100000:3.0:1787580088.891982:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51886050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+48:11526:x1874413239738752:12345-192.168.202.36@tcp:35:lfs.0 Request processed in 288us (474us total) trans 4294967446 rc 0/0 00000100:00100000:3.0:1787580088.891991:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 44 00000100:00100000:1.0:1787580088.953680:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580088.954013:0:8897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239739008 00000100:00100000:2.0:1787580088.954023:0:8897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239739008 00000100:00100000:2.0:1787580088.954134:0:8897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 160 00000100:00100000:2.0:1787580088.954145:0:8897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fad43127100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+48:11532:x1874413239739008:12345-192.168.202.36@tcp:101:bash.0 00010000:00010000:2.0:1787580088.954168:0:8897:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787580088.954189:0:8897:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac20833820e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d31b expref: -99 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580088.954297:0:8897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208338215 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580088.954313:0:8897:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7800/0xc86deac2083381f9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d30d expref: 49 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580088.954322:0:8897:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208338215 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580088.954371:0:8897:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7800/0xc86deac2083381f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d30d expref: 49 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580088.954426:0:8897:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7800/0xc86deac2083381f9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d30d expref: 49 pid: 5854 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580088.954440:0:8897:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae74639c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8897:1874413262810368:192.168.202.36@tcp:104: 00000100:00100000:2.0:1787580088.954533:0:8897:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae50f8ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1787580088.957445:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580088.957527:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239739136 00000100:00100000:1.0:1787580088.957547:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239739136 00010000:00010000:1.0:1787580088.957585:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7800/0xc86deac2083381f9 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d30d expref: 50 pid: 5854 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580088.957625:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 69 00000100:00100000:1.0:1787580088.957635:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae504b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+50:2360:x1874413239739136:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787580088.957649:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787580088.957655:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7800/0xc86deac2083381f9 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d30d expref: 50 pid: 5854 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580088.957669:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7800/0xc86deac2083381f9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d30d expref: 50 pid: 5854 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580088.957690:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8fae56e35e00) 00010000:00010000:1.0:1787580088.957696:0:5840:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208338215 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580088.957706:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208338215 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580088.957714:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208338215 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580088.957751:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787580088.957821:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae504b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+50:2360:x1874413239739136:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 188us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580088.957829:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 69 00010000:00010000:2.0:1787580088.959209:0:8897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7800/0xc86deac2083381f9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d30d expref: 49 pid: 5854 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580088.959235:0:8897:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae74639c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8897:1874413262810368:192.168.202.36@tcp:104: 00010000:00010000:2.0:1787580088.959261:0:8897:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208338215 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580088.959272:0:8897:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208338215 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580088.959279:0:8897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208338215 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787580088.959300:0:8897:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:2.0:1787580088.959492:0:8897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac20833820e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d31b expref: 50 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580088.959507:0:8897:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208338215 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d31b expref: 49 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580088.959533:0:8897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8fae56e35e00) 00010000:00010000:2.0:1787580088.959537:0:8897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787580088.959540:0:8897:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae48db9c00, rc 0) 00000100:00100000:2.0:1787580088.959815:0:8897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fad43127100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+49:11532:x1874413239739008:12345-192.168.202.36@tcp:101:bash.0 Request processed in 5670us (6143us total) trans 4294967447 rc 0/0 00000100:00100000:2.0:1787580088.959824:0:8897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 160 00000100:00100000:0.0:1787580088.962236:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580088.962325:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239739392 00000100:00100000:2.0:1787580088.962336:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239739392 00000100:00100000:2.0:1787580088.962450:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 161 00000100:00100000:2.0:1787580088.962460:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae504b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+49:11532:x1874413239739392:12345-192.168.202.36@tcp:36:bash.0 00010000:00010000:2.0:1787580088.963051:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac208338223 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580088.963071:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac208338223 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580088.963082:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac208338223 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787580088.963140:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:2.0:1787580088.963168:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008e20001d reply state 00000000e90310b6 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac208338223 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580088.963178:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787580088.963283:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae504b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+52:11532:x1874413239739392:12345-192.168.202.36@tcp:36:bash.0 Request processed in 823us (1053us total) trans 4294967449 rc 0/0 00000100:00100000:2.0:1787580088.963290:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 161 00000020:00080000:2.0:1787580088.963311:0:5852:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787580088.967043:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac208338223 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580088.967082:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac208338223 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580088.967090:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac208338223 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580088.967096:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db8800 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:1.0:1787580088.967101:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac208338223 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580088.967109:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac208338223 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580088.967127:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8fae56e35e00) 00010000:00010000:1.0:1787580088.967130:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787580088.967135:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac208338223 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580088.967140:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac208338223 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580088.969585:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580088.969855:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239739520 00000100:00100000:3.0:1787580088.969866:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239739520 00000100:00100000:3.0:1787580088.969928:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 162 00000100:00100000:3.0:1787580088.969937:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae504b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+51:11532:x1874413239739520:12345-192.168.202.36@tcp:101:bash.0 00010000:00010000:3.0:1787580088.969962:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787580088.969984:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6a00/0xc86deac20833822a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d322 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580088.970068:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7000/0xc86deac208338231 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580088.970084:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208338215 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d31b expref: 52 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580088.970094:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7000/0xc86deac208338231 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580088.970132:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208338215 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d31b expref: 52 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580088.970145:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208338215 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d31b expref: 52 pid: 8897 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580088.970158:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae48c91880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5854:1874413262810496:192.168.202.36@tcp:104: 00000100:00100000:3.0:1787580088.970265:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae6d67e180 going to sleep for 11 seconds 00000100:00100000:3.0:1787580088.987636:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae48c91880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5854:1874413262810496:192.168.202.36@tcp:104: 00010000:00010000:3.0:1787580088.987678:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7000/0xc86deac208338231 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580088.989128:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580088.989675:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239739648 00000100:00100000:2.0:1787580088.989686:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239739648 00010000:00010000:2.0:1787580088.989745:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208338215 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d31b expref: 53 pid: 8897 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580088.989791:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 70 00000100:00100000:2.0:1787580088.989813:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae504b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+53:2359:x1874413239739648:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787580088.989831:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787580088.989839:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208338215 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d31b expref: 53 pid: 8897 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580088.989854:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208338215 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d31b expref: 53 pid: 8897 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580088.989881:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208338215 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d31b expref: 53 pid: 8897 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580088.989899:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8fae56e35e00) 00010000:00010000:2.0:1787580088.989904:0:5838:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7000/0xc86deac208338231 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580088.989916:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7000/0xc86deac208338231 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580088.989924:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7000/0xc86deac208338231 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580088.989954:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787580088.990023:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae504b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+52:2359:x1874413239739648:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 222us (900us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580088.990042:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 70 00010000:00010000:3.0:1787580088.990238:0:5854:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7000/0xc86deac208338231 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580088.990249:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7000/0xc86deac208338231 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787580088.990306:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1787580088.990312:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787580088.990335:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7000/0xc86deac208338231 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580088.990370:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6a00/0xc86deac20833822a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d322 expref: 52 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580088.990442:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7000/0xc86deac208338231 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d322 expref: 51 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580088.990452:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8fae56e35e00) 00010000:00010000:3.0:1787580088.990455:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787580088.990458:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae5f6d7000, rc 0) 00000100:00100000:3.0:1787580088.990486:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae504b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+51:11532:x1874413239739520:12345-192.168.202.36@tcp:101:bash.0 Request processed in 20550us (20912us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580088.990494:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 162 00000100:00100000:0.0:1787580088.993701:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580088.993857:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239739904 00000100:00100000:3.0:1787580088.993884:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239739904 00000100:00100000:3.0:1787580088.993946:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 45 00000100:00100000:3.0:1787580088.993957:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae504b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+51:11532:x1874413239739904:12345-192.168.202.36@tcp:35:bash.0 00000100:00100000:3.0:1787580088.994916:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae504b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+52:11532:x1874413239739904:12345-192.168.202.36@tcp:35:bash.0 Request processed in 955us (1220us total) trans 4294967450 rc 0/0 00000100:00100000:3.0:1787580088.994930:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 45 00000100:00100000:0.0:1787580089.069844:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580089.070069:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239740160 00000100:00100000:1.0:1787580089.070082:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239740160 00000100:00100000:1.0:1787580089.070173:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 163 00000100:00100000:1.0:1787580089.070185:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae504b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+52:11542:x1874413239740160:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:1.0:1787580089.070210:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787580089.070234:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac208338238 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d329 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787580089.070358:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1787580089.070542:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac208338238 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d329 expref: 54 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580089.070558:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fae4c7d9c00) 00010000:00010000:1.0:1787580089.070562:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787580089.070567:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac208338238 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d329 expref: 54 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580089.070582:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae4ca59200, rc 0) 00000100:00080000:2.0:1787580089.070722:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787580089.070884:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae504b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+53:11542:x1874413239740160:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 700us (1052us total) trans 4294967451 rc 301/301 00000100:00100000:1.0:1787580089.070892:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 163 00000100:00100000:0.0:1787580089.074835:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580089.075005:0:8897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239740288 00000100:00100000:2.0:1787580089.075016:0:8897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239740288 00000100:00100000:2.0:1787580089.075079:0:8897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 164 00000100:00100000:2.0:1787580089.075090:0:8897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+53:11542:x1874413239740288:12345-192.168.202.36@tcp:34:lfs.0 00010000:00010000:2.0:1787580089.075180:0:8897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208338246 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.075198:0:8897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208338246 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.075211:0:8897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208338246 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.075227:0:8897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac20833824d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.075234:0:8897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac20833824d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.075240:0:8897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac20833824d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.075351:0:8897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac208338254 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.075360:0:8897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac208338254 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.075369:0:8897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac208338254 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787580089.075584:0:8897:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac208338254 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.075598:0:8897:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208338246 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.075603:0:8897:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208338246 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.075610:0:8897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208338246 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.075616:0:8897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db9c00 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:2.0:1787580089.075620:0:8897:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208338246 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.075718:0:8897:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208338246 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.075819:0:8897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8fae4c7d9800) 00010000:00010000:2.0:1787580089.075823:0:8897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787580089.075829:0:8897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208338246 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.075836:0:8897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208338246 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.075849:0:8897:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac20833824d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.075854:0:8897:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac20833824d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.075868:0:8897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac20833824d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.075872:0:8897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db9e00 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:2.0:1787580089.075875:0:8897:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac20833824d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.075881:0:8897:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac20833824d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.075889:0:8897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8fae4c7d9b00) 00010000:00010000:2.0:1787580089.075891:0:8897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787580089.075894:0:8897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac20833824d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.075900:0:8897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac20833824d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.075915:0:8897:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac208338254 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.075922:0:8897:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac208338254 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.075927:0:8897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac208338254 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.075933:0:8897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db8200 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:2.0:1787580089.075935:0:8897:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac208338254 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.075950:0:8897:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac208338254 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.075959:0:8897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8fae56e35e00) 00010000:00010000:2.0:1787580089.075961:0:8897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787580089.075964:0:8897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac208338254 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.075970:0:8897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac208338254 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580089.076210:0:8897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+53:11542:x1874413239740288:12345-192.168.202.36@tcp:34:lfs.0 Request processed in 1119us (1384us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580089.076220:0:8897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 164 00000100:00100000:0.0:1787580089.079647:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580089.079915:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239740544 00000100:00100000:2.0:1787580089.079927:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239740544 00000100:00100000:2.0:1787580089.080033:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 46 00000100:00100000:2.0:1787580089.080044:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+53:11542:x1874413239740544:12345-192.168.202.36@tcp:35:lfs.0 00000100:00100000:2.0:1787580089.080374:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+54:11542:x1874413239740544:12345-192.168.202.36@tcp:35:lfs.0 Request processed in 330us (747us total) trans 4294967452 rc 0/0 00000100:00100000:2.0:1787580089.080409:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 46 00000100:00100000:1.0:1787580089.112541:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580089.112658:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239740800 00000100:00100000:0.0:1787580089.112668:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239740800 00000100:00100000:0.0:1787580089.112737:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 165 00000100:00100000:0.0:1787580089.112748:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74f00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+54:11545:x1874413239740800:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:0.0:1787580089.112774:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787580089.112794:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb000/0xc86deac20833825b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d330 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580089.112899:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea400/0xc86deac208338262 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580089.112913:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea400/0xc86deac208338262 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580089.112924:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea400/0xc86deac208338262 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580089.112939:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feac00/0xc86deac208338269 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580089.112946:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feac00/0xc86deac208338269 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580089.112954:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feac00/0xc86deac208338269 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580089.113085:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac208338270 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580089.113095:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac208338270 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580089.113102:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac208338270 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787580089.113113:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1787580089.113203:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea400/0xc86deac208338262 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580089.113211:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea400/0xc86deac208338262 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580089.113226:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea400/0xc86deac208338262 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580089.113232:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae50fea400 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:0.0:1787580089.113236:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea400/0xc86deac208338262 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580089.113244:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea400/0xc86deac208338262 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580089.113257:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8fae4c7d9800) 00010000:00010000:0.0:1787580089.113260:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787580089.113264:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea400/0xc86deac208338262 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580089.113270:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea400/0xc86deac208338262 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580089.113284:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feac00/0xc86deac208338269 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580089.113291:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feac00/0xc86deac208338269 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580089.113297:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feac00/0xc86deac208338269 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580089.113302:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae50feac00 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:0.0:1787580089.113305:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feac00/0xc86deac208338269 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580089.113323:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feac00/0xc86deac208338269 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580089.113332:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8fae56e35200) 00010000:00010000:0.0:1787580089.113334:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787580089.113337:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feac00/0xc86deac208338269 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580089.113344:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feac00/0xc86deac208338269 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580089.113609:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb000/0xc86deac20833825b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d330 expref: 57 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580089.113672:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac208338270 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d330 expref: 56 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580089.113680:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8fae56e35e00) 00010000:00010000:0.0:1787580089.113683:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787580089.113686:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae50feb600, rc 0) 00000100:00100000:0.0:1787580089.113910:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74f00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+56:11545:x1874413239740800:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 1163us (1381us total) trans 4294967453 rc 0/0 00000100:00100000:0.0:1787580089.113919:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 165 00000100:00100000:0.0:1787580089.117933:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580089.117977:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580089.118103:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239740928 00000100:00100000:1.0:1787580089.118114:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239740928 00000100:00100000:1.0:1787580089.118187:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 12 00000100:00100000:1.0:1787580089.118198:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48d86050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+56:2361:x1874413239740928:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787580089.118216:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787580089.118244:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac208338270 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d330 expref: 56 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580089.118267:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8fae56e35e00) 00010000:00010000:1.0:1787580089.118274:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787580089.118335:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48d86050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+55:2361:x1874413239740928:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 140us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580089.118343:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 12 00000100:00100000:3.0:1787580089.118893:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239741056 00000100:00100000:3.0:1787580089.118898:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239741056 00000100:00100000:3.0:1787580089.118943:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 166 00000100:00100000:3.0:1787580089.118951:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+55:11545:x1874413239741056:12345-192.168.202.36@tcp:54:lfs.0 00010000:00010000:3.0:1787580089.119007:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6a00/0xc86deac20833827e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580089.119022:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6a00/0xc86deac20833827e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580089.119033:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6a00/0xc86deac20833827e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580089.119060:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6a00/0xc86deac20833827e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580089.119068:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6a00/0xc86deac20833827e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580089.119076:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6a00/0xc86deac20833827e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580089.119083:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae5f6d6a00 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:3.0:1787580089.119088:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6a00/0xc86deac20833827e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580089.119112:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6a00/0xc86deac20833827e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580089.119122:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8fae56e35e00) 00010000:00010000:3.0:1787580089.119125:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787580089.119129:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6a00/0xc86deac20833827e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580089.119136:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6a00/0xc86deac20833827e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580089.119193:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+55:11545:x1874413239741056:12345-192.168.202.36@tcp:54:lfs.0 Request processed in 242us (1269us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580089.119201:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 166 00000100:00100000:0.0:1787580089.127169:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580089.127246:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239741312 00000100:00100000:3.0:1787580089.127258:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239741312 00000100:00100000:3.0:1787580089.127317:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 47 00000100:00100000:3.0:1787580089.127328:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+55:11545:x1874413239741312:12345-192.168.202.36@tcp:35:lfs.0 00000100:00100000:3.0:1787580089.127599:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+56:11545:x1874413239741312:12345-192.168.202.36@tcp:35:lfs.0 Request processed in 272us (441us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1787580089.127608:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 47 00000100:00100000:1.0:1787580089.250744:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580089.250859:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239741568 00000100:00100000:3.0:1787580089.250872:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239741568 00000100:00100000:3.0:1787580089.250948:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 167 00000100:00100000:3.0:1787580089.250960:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74f02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+56:11563:x1874413239741568:12345-192.168.202.36@tcp:101:cat.0 00010000:00010000:3.0:1787580089.250990:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787580089.251014:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6a00/0xc86deac208338285 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d337 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580089.251147:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6e00/0xc86deac20833828c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580089.251165:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6e00/0xc86deac20833828c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580089.251180:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6e00/0xc86deac20833828c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787580089.251191:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1787580089.251337:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6a00/0xc86deac208338285 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d337 expref: 59 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580089.251357:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6e00/0xc86deac20833828c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d337 expref: 58 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580089.251367:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8fae56e35e00) 00010000:00010000:3.0:1787580089.251370:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787580089.251373:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae5f6d6e00, rc 0) 00000100:00100000:0.0:1787580089.255089:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74f02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+58:11563:x1874413239741568:12345-192.168.202.36@tcp:101:cat.0 Request processed in 4115us (4354us total) trans 4294967455 rc 0/0 00000100:00100000:0.0:1787580089.260575:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 167 00000100:00100000:0.0:1787580089.282375:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580089.282556:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239741696 00000100:00100000:3.0:1787580089.282567:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239741696 00000100:00100000:3.0:1787580089.282738:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 168 00000100:00100000:3.0:1787580089.282749:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+58:11564:x1874413239741696:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:3.0:1787580089.282777:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787580089.282809:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6a00/0xc86deac20833829a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d33e expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580089.282886:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6000/0xc86deac2083382a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580089.282920:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6000/0xc86deac2083382a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580089.282934:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6000/0xc86deac2083382a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787580089.283006:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:3.0:1787580089.283010:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787580089.283031:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6000/0xc86deac2083382a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580089.283062:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6a00/0xc86deac20833829a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d33e expref: 60 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580089.283084:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6000/0xc86deac2083382a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d33e expref: 59 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580089.283094:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8fae4c7d9800) 00010000:00010000:3.0:1787580089.283096:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787580089.283100:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae5f6d6000, rc 0) 00000100:00100000:3.0:1787580089.283180:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+59:11564:x1874413239741696:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 433us (819us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580089.283188:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 168 00000100:00100000:0.0:1787580089.288048:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580089.288122:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239742080 00000100:00100000:3.0:1787580089.288133:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239742080 00000100:00100000:3.0:1787580089.288193:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 48 00000100:00100000:3.0:1787580089.288205:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7e97e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+59:11564:x1874413239742080:12345-192.168.202.36@tcp:35:lfs.0 00000100:00100000:3.0:1787580089.288889:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7e97e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+60:11564:x1874413239742080:12345-192.168.202.36@tcp:35:lfs.0 Request processed in 682us (848us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1787580089.288920:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 48 00000100:00100000:1.0:1787580089.291274:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580089.291578:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239742208 00000100:00100000:0.0:1787580089.291590:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239742208 00000100:00100000:1.0:1787580089.292005:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 13 00000100:00100000:1.0:1787580089.292016:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74f01c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+60:11564:x1874413239742208:12345-192.168.202.36@tcp:103:lfs.0 00010000:00010000:1.0:1787580089.292035:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787580089.292062:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7000/0xc86deac208338231 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d322 expref: 60 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580089.292083:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6e00/0xc86deac20833828c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d337 expref: 59 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580089.292097:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feaa00/0xc86deac20833813c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d2e3 expref: 58 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580089.292108:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8fae56e35e00) 00010000:00010000:1.0:1787580089.292117:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787580089.292173:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74f01c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+57:11564:x1874413239742208:12345-192.168.202.36@tcp:103:lfs.0 Request processed in 158us (908us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580089.292181:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 13 00000100:00100000:0.0:1787580089.294055:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580089.294148:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239742336 00000100:00100000:2.0:1787580089.294160:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239742336 00000100:00100000:2.0:1787580089.294221:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 169 00000100:00100000:2.0:1787580089.294231:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7e97dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+57:11564:x1874413239742336:12345-192.168.202.36@tcp:58:lfs.0 00010000:00010000:2.0:1787580089.294355:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac2083382a8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.294418:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac2083382a8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.294431:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac2083382a8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787580089.294890:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1787580089.295017:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7e97dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+57:11564:x1874413239742336:12345-192.168.202.36@tcp:58:lfs.0 Request processed in 787us (969us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580089.295027:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 169 00000100:00100000:3.0:1787580089.322198:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580089.322603:0:8897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239742464 00000100:00100000:2.0:1787580089.322614:0:8897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239742464 00000100:00100000:2.0:1787580089.322687:0:8897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 170 00000100:00100000:2.0:1787580089.322699:0:8897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+57:11566:x1874413239742464:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:2.0:1787580089.322737:0:8897:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787580089.322762:0:8897:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac2083382af lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d345 expref: -99 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.322848:0:8897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac2083382b6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.322865:0:8897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac2083382b6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.322877:0:8897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac2083382b6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.322893:0:8897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac2083382bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.322919:0:8897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac2083382bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.322927:0:8897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac2083382bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.323039:0:8897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9400/0xc86deac2083382c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.323048:0:8897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9400/0xc86deac2083382c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.323055:0:8897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9400/0xc86deac2083382c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787580089.323097:0:8897:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787580089.323102:0:8897:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787580089.323124:0:8897:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9400/0xc86deac2083382c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.323138:0:8897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9400/0xc86deac2083382c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.323145:0:8897:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac2083382b6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.323151:0:8897:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac2083382b6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.323158:0:8897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac2083382b6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.323175:0:8897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db9e00 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:2.0:1787580089.323180:0:8897:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac2083382b6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.323189:0:8897:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac2083382b6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.323204:0:8897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8fae4c7d9800) 00010000:00010000:2.0:1787580089.323208:0:8897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787580089.323213:0:8897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac2083382b6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.323219:0:8897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac2083382b6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.323238:0:8897:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac2083382bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.323243:0:8897:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac2083382bd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.323250:0:8897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac2083382bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.323254:0:8897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db8800 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:2.0:1787580089.323256:0:8897:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac2083382bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.323263:0:8897:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac2083382bd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.323281:0:8897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8fae4c7d9e00) 00010000:00010000:2.0:1787580089.323284:0:8897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787580089.323287:0:8897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac2083382bd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.323294:0:8897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac2083382bd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.323330:0:8897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac2083382af lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d345 expref: 59 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.323344:0:8897:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9400/0xc86deac2083382c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d345 expref: 58 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.323352:0:8897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8fae4c7d9b00) 00010000:00010000:2.0:1787580089.323354:0:8897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787580089.323356:0:8897:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae48db9400, rc 0) 00000100:00100000:2.0:1787580089.323467:0:8897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+58:11566:x1874413239742464:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 769us (1277us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580089.323476:0:8897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 170 00000040:00080000:1.0:1787580089.331673:0:11700:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787580089.331686:0:11700:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787580089.331748:0:11700:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1787580089.331758:0:11700:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787580089.331924:0:11700:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae74f00700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11700:1874413262810624:192.168.202.36@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787580089.332046:0:11700:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae4c523600 going to sleep for 11 seconds 00000100:00100000:2.0:1787580089.338779:0:11700:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae74f00700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11700:1874413262810624:192.168.202.36@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787580089.340013:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580089.340422:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239742592 00000100:00100000:2.0:1787580089.340432:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239742592 00000100:00100000:2.0:1787580089.340485:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 171 00000100:00100000:2.0:1787580089.340496:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7e97ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+58:11568:x1874413239742592:12345-192.168.202.36@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787580089.340530:0:5853:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787580089.340849:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7e97ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+58:11568:x1874413239742592:12345-192.168.202.36@tcp:53:lhsmtool_posix.0 Request processed in 353us (842us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580089.340857:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 171 00000100:00100000:3.0:1787580089.343868:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580089.344902:0:8897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239742720 00000100:00100000:2.0:1787580089.344915:0:8897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239742720 00000100:00100000:2.0:1787580089.344998:0:8897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 172 00000100:00100000:2.0:1787580089.345010:0:8897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+58:11568:x1874413239742720:12345-192.168.202.36@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787580089.345096:0:8897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac2083382cb lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.345193:0:8897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac2083382cb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.345313:0:8897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac2083382cb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.345335:0:8897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac2083382d2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.345343:0:8897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac2083382d2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.345350:0:8897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac2083382d2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.345380:0:8897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9800/0xc86deac2083382d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.345587:0:8897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9800/0xc86deac2083382d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.345595:0:8897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9800/0xc86deac2083382d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787580089.346460:0:8897:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787580089.346467:0:8897:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787580089.346484:0:8897:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9800/0xc86deac2083382d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.346499:0:8897:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac2083382cb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.346506:0:8897:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac2083382cb lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.346514:0:8897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac2083382cb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.346521:0:8897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db8800 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:2.0:1787580089.346527:0:8897:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac2083382cb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.346534:0:8897:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac2083382cb lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.346551:0:8897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8fae5bb2f000) 00010000:00010000:2.0:1787580089.346554:0:8897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787580089.346560:0:8897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac2083382cb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.346566:0:8897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac2083382cb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.346583:0:8897:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac2083382d2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.346604:0:8897:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac2083382d2 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.346610:0:8897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac2083382d2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.346616:0:8897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db9e00 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:2.0:1787580089.346632:0:8897:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac2083382d2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.346639:0:8897:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac2083382d2 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.346646:0:8897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff8fae4c7d9e00) 00010000:00010000:2.0:1787580089.346649:0:8897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787580089.346652:0:8897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac2083382d2 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.346658:0:8897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac2083382d2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.346678:0:8897:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9800/0xc86deac2083382d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.346684:0:8897:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9800/0xc86deac2083382d9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.346691:0:8897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9800/0xc86deac2083382d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.346696:0:8897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db9800 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:2.0:1787580089.346705:0:8897:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9800/0xc86deac2083382d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.346712:0:8897:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9800/0xc86deac2083382d9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.346738:0:8897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8fae4c7d9b00) 00010000:00010000:2.0:1787580089.346741:0:8897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787580089.346744:0:8897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9800/0xc86deac2083382d9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.346751:0:8897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9800/0xc86deac2083382d9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580089.346876:0:8897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+58:11568:x1874413239742720:12345-192.168.202.36@tcp:34:lhsmtool_posix.0 Request processed in 1863us (3017us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580089.346888:0:8897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 172 00000100:00100000:1.0:1787580089.350529:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580089.350911:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239742976 00000100:00100000:0.0:1787580089.350922:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239742976 00000100:00100000:0.0:1787580089.350982:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 173 00000100:00100000:0.0:1787580089.350992:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74f00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+58:11568:x1874413239742976:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787580089.351015:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787580089.351040:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea000/0xc86deac2083382e0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d34c expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580089.351313:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea800/0xc86deac2083382e7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580089.351331:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea800/0xc86deac2083382e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580089.351344:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea800/0xc86deac2083382e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787580089.351358:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1787580089.351537:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea800/0xc86deac2083382e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580089.351544:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea800/0xc86deac2083382e7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580089.351579:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea800/0xc86deac2083382e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580089.351585:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae50fea800 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:0.0:1787580089.351589:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea800/0xc86deac2083382e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580089.351597:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea800/0xc86deac2083382e7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580089.351610:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8fae4c7d9b00) 00010000:00010000:0.0:1787580089.351614:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787580089.351619:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea800/0xc86deac2083382e7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580089.351626:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea800/0xc86deac2083382e7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580089.351672:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea000/0xc86deac2083382e0 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d34c expref: 60 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580089.351683:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8fae5bb2f000) 00010000:00010000:0.0:1787580089.351686:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787580089.351690:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea000/0xc86deac2083382e0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d34c expref: 60 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580089.351700:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae50fea000, rc 0) 00000100:00100000:0.0:1787580089.352632:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74f00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+59:11568:x1874413239742976:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 Request processed in 1626us (2099us total) trans 4294967457 rc 301/301 00000100:00100000:0.0:1787580089.352658:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 173 00000100:00100000:0.0:1787580089.375754:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580089.376137:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239743104 00000100:00100000:3.0:1787580089.376149:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239743104 00000100:00100000:3.0:1787580089.376330:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 174 00000100:00100000:3.0:1787580089.376343:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7e97ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+59:11568:x1874413239743104:12345-192.168.202.36@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787580089.376412:0:5854:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787580089.376543:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7e97ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+59:11568:x1874413239743104:12345-192.168.202.36@tcp:53:lhsmtool_posix.0 Request processed in 201us (803us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580089.376551:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 174 00000100:00100000:0.0:1787580089.385923:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580089.386512:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239743360 00000100:00100000:2.0:1787580089.386527:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239743360 00000100:00100000:2.0:1787580089.386610:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 175 00000100:00100000:2.0:1787580089.386635:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7e97c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+59:11568:x1874413239743360:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787580089.386665:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787580089.386668:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787580089.386700:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6000/0xc86deac2083382a1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d33e expref: 59 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.386724:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8fae4c7d9800) 00010000:00010000:2.0:1787580089.386729:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787580089.386744:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9800/0xc86deac2083382f5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d353 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787580089.393910:0:5853:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:2.0:1787580089.394277:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac2083382fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.394298:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac2083382fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.394311:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac2083382fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.394402:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9800/0xc86deac2083382f5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d353 expref: 61 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.394423:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac2083382fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d353 expref: 60 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.394432:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8fae4c7d9e00) 00010000:00010000:2.0:1787580089.394435:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787580089.394438:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae48db9e00, rc 0) 00000100:00100000:2.0:1787580089.394520:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7e97c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+60:11568:x1874413239743360:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 Request processed in 7898us (8606us total) trans 4294967458 rc 0/0 00000100:00100000:2.0:1787580089.394529:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 175 00000100:00100000:1.0:1787580089.399468:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580089.399658:0:8897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239743616 00000100:00100000:2.0:1787580089.399671:0:8897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239743616 00000100:00100000:2.0:1787580089.399772:0:8897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 176 00000100:00100000:2.0:1787580089.399784:0:8897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+60:11568:x1874413239743616:12345-192.168.202.36@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787580089.399874:0:8897:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787580089.399923:0:8897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac2083382fc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d353 expref: 60 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.399943:0:8897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8fae4c7d9e00) 00010000:00010000:2.0:1787580089.399955:0:8897:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787580089.399982:0:8897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac20833830a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.399996:0:8897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac20833830a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.400006:0:8897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac20833830a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.400020:0:8897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8400/0xc86deac208338311 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x10c83b0e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.400027:0:8897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8400/0xc86deac208338311 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x10c83b0e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.400033:0:8897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8400/0xc86deac208338311 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x10c83b0e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.400114:0:8897:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac20833830a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.400120:0:8897:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac20833830a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.400127:0:8897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac20833830a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.400133:0:8897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db8800 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:2.0:1787580089.400146:0:8897:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac20833830a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.400154:0:8897:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac20833830a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.400163:0:8897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8fae4c7d9800) 00010000:00010000:2.0:1787580089.400166:0:8897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787580089.400170:0:8897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac20833830a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.400176:0:8897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac20833830a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.400185:0:8897:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8400/0xc86deac208338311 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x10c83b0e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.400192:0:8897:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8400/0xc86deac208338311 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x10c83b0e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.400198:0:8897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8400/0xc86deac208338311 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x10c83b0e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.400203:0:8897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db8400 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:2.0:1787580089.400205:0:8897:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8400/0xc86deac208338311 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x10c83b0e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.400211:0:8897:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8400/0xc86deac208338311 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x10c83b0e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.400217:0:8897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x10c83b0e (ffff8fae4c7d9500) 00010000:00010000:2.0:1787580089.400219:0:8897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787580089.400229:0:8897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8400/0xc86deac208338311 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x10c83b0e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.400234:0:8897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8400/0xc86deac208338311 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x10c83b0e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580089.400326:0:8897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+59:11568:x1874413239743616:12345-192.168.202.36@tcp:36:lhsmtool_posix.0 Request processed in 544us (874us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787580089.400334:0:8897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 176 00000100:00100000:1.0:1787580089.408693:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580089.408904:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239743744 00000100:00100000:3.0:1787580089.408918:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239743744 00000100:00100000:3.0:1787580089.408980:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 177 00000100:00100000:3.0:1787580089.408991:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d684700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+59:11568:x1874413239743744:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787580089.409012:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787580089.409035:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6a00/0xc86deac208338318 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d35a expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580089.409072:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7600/0xc86deac20833831f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580089.409088:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7600/0xc86deac20833831f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580089.409098:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7600/0xc86deac20833831f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580089.409205:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6a00/0xc86deac208338318 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d35a expref: 61 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580089.409225:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7600/0xc86deac20833831f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d35a expref: 60 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580089.409233:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8fae530b1c00) 00010000:00010000:3.0:1787580089.409236:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787580089.409241:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae5f6d7600, rc 0) 00000100:00100000:3.0:1787580089.409303:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d684700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+60:11568:x1874413239743744:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 Request processed in 313us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580089.409311:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 177 00000100:00100000:3.0:1787580089.411812:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580089.412127:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239744000 00000100:00100000:1.0:1787580089.412138:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239744000 00000100:00100000:1.0:1787580089.412202:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 178 00000100:00100000:1.0:1787580089.412213:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7f5bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+60:11568:x1874413239744000:12345-192.168.202.36@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787580089.412329:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58200/0xc86deac208338326 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580089.412350:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58200/0xc86deac208338326 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580089.412362:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58200/0xc86deac208338326 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787580089.413056:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:1.0:1787580089.413069:0:5854:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 437168684734ns, next at 438168682477ns, rc = 0 00000004:00010000:1.0:1787580089.413168:0:5854:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000ccd8eb4 reply state 0000000030c671c7 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58200/0xc86deac208338326 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580089.413180:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787580089.413292:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7f5bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+62:11568:x1874413239744000:12345-192.168.202.36@tcp:36:lhsmtool_posix.0 Request processed in 1079us (1495us total) trans 4294967459 rc 0/0 00000100:00100000:1.0:1787580089.413301:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 178 00000100:00100000:2.0:1787580089.418255:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580089.418673:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239744128 00000100:00100000:0.0:1787580089.418685:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239744128 00000100:00100000:0.0:1787580089.418934:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 179 00000100:00100000:0.0:1787580089.418946:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74639c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+62:11568:x1874413239744128:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787580089.418973:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787580089.418993:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea800/0xc86deac20833832d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d361 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580089.419060:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea800/0xc86deac20833832d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d361 expref: 63 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580089.419076:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea800/0xc86deac20833832d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d361 expref: 63 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580089.419096:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8fae530b1c00) 00010000:00010000:0.0:1787580089.419099:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787580089.419103:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae50fea800, rc 0) 00000100:00100000:0.0:1787580089.419250:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74639c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+63:11568:x1874413239744128:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 Request processed in 306us (1006us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580089.419259:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 179 00010000:00010000:1.0:1787580089.419438:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58200/0xc86deac208338326 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580089.419447:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58200/0xc86deac208338326 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580089.419454:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58200/0xc86deac208338326 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580089.419480:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae4ca58200 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:1.0:1787580089.419485:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58200/0xc86deac208338326 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580089.419492:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58200/0xc86deac208338326 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580089.419507:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8fae530b1c00) 00010000:00010000:1.0:1787580089.419509:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787580089.419513:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58200/0xc86deac208338326 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580089.419518:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58200/0xc86deac208338326 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580089.429097:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580089.429194:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239744256 00000100:00100000:3.0:1787580089.429207:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239744256 00000100:00100000:3.0:1787580089.429298:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 51 00000100:00100000:3.0:1787580089.429310:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d687480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:2360:x1874413239744256:12345-192.168.202.36@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1787580089.430022:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787580089.430760:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d687480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+7:2360:x1874413239744256:12345-192.168.202.36@tcp:2:lhsmtool_posix.0 Request processed in 1443us (1669us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1787580089.430774:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 51 00000100:00100000:2.0:1787580089.445994:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580089.446092:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239744512 00000100:00100000:0.0:1787580089.446104:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239744512 00000100:00100000:0.0:1787580089.446160:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 49 00000100:00100000:0.0:1787580089.446170:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74638700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+62:11568:x1874413239744512:12345-192.168.202.36@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787580089.446470:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74638700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+63:11568:x1874413239744512:12345-192.168.202.36@tcp:35:lhsmtool_posix.0 Request processed in 301us (489us total) trans 4294967460 rc 0/0 00000100:00100000:0.0:1787580089.446478:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 49 00000100:00100000:1.0:1787580089.455302:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580089.455414:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239744768 00000100:00100000:3.0:1787580089.455425:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239744768 00000100:00100000:3.0:1787580089.455489:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 180 00000100:00100000:3.0:1787580089.455500:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae504b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+63:11568:x1874413239744768:12345-192.168.202.36@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787580089.455974:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae504b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+63:11568:x1874413239744768:12345-192.168.202.36@tcp:57:lhsmtool_posix.0 Request processed in 473us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580089.455993:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 180 00000004:00080000:3.0:1787580089.460911:0:6735:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 437216524641ns, next at 438216522526ns, rc = 0 00000100:00100000:0.0:1787580089.461125:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7f5b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262810752:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787580089.461209:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580089.461342:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262810752 00000100:00100000:3.0:1787580089.461351:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262810752 00000100:00100000:3.0:1787580089.461446:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787580089.461458:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7e97fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262810752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787580089.461521:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787580089.461576:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7e97fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262810752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580089.461584:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787580089.461632:0:3316:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:3.0:1787580089.461638:0:3316:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:3.0:1787580089.461666:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7f5b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262810752:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787580089.462157:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787580089.464814:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580089.464949:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239744896 00000100:00100000:3.0:1787580089.464959:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239744896 00000100:00100000:3.0:1787580089.465009:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 181 00000100:00100000:3.0:1787580089.465020:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae504b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+63:11568:x1874413239744896:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787580089.465039:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787580089.465060:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6a00/0xc86deac208338334 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d368 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580089.465129:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7400/0xc86deac20833833b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580089.465144:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7400/0xc86deac20833833b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580089.465168:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7400/0xc86deac20833833b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787580089.465203:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787580089.465221:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7400/0xc86deac20833833b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580089.465247:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6a00/0xc86deac208338334 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d368 expref: 65 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580089.465264:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7400/0xc86deac20833833b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d368 expref: 64 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580089.465273:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8fae530b1c00) 00010000:00010000:3.0:1787580089.465276:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787580089.465279:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae5f6d7400, rc 0) 00000100:00100000:3.0:1787580089.465339:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae504b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+64:11568:x1874413239744896:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 Request processed in 321us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580089.465346:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 181 00000100:00100000:0.0:1787580089.473501:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580089.473571:0:10268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239745024 00000100:00100000:3.0:1787580089.473581:0:10268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239745024 00000100:00100000:3.0:1787580089.473641:0:10268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 52 00000100:00100000:3.0:1787580089.473654:0:10268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7e97f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+7:2361:x1874413239745024:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787580089.473675:0:10268:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787580089.473699:0:10268:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ae60863/0xc86deac208338342 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d36f expref: -99 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787580089.473745:0:10268:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8c4eb9, blocks: 0x1 00010000:00010000:3.0:1787580089.473768:0:10268:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=437s v=(0 0) 00010000:00010000:3.0:1787580089.473773:0:10268:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787580089.473782:0:10268:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ae60863/0xc86deac208338342 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d36f expref: 8 pid: 10268 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580089.473810:0:10268:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008ae60863/0xc86deac208338342 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d36f expref: 8 pid: 10268 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580089.473825:0:10268:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae5f6d6200, rc 0) 00000100:00100000:3.0:1787580089.473893:0:10268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7e97f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+8:2361:x1874413239745024:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 Request processed in 241us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580089.473901:0:10268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 52 00000100:00100000:1.0:1787580089.479587:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580089.485523:0:8897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239745280 00000100:00100000:0.0:1787580089.485542:0:8897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239745280 00000100:00100000:0.0:1787580089.488099:0:8897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 182 00000100:00100000:0.0:1787580089.488121:0:8897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5f6fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+64:11568:x1874413239745280:12345-192.168.202.36@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787580089.488263:0:8897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5f6fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+64:11568:x1874413239745280:12345-192.168.202.36@tcp:57:lhsmtool_posix.0 Request processed in 150us (8686us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580089.488271:0:8897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 182 00000100:00100000:0.0:1787580089.493818:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580089.493953:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239745408 00000100:00100000:3.0:1787580089.493965:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239745408 00000100:00100000:3.0:1787580089.494024:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 53 00000100:00100000:3.0:1787580089.494035:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7e97c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+8:11568:x1874413239745408:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787580089.494053:0:6707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787580089.494072:0:6707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008a6998ca/0xc86deac208338349 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d376 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580089.494104:0:6707:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008ae60863/0xc86deac208338342 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d36f expref: 9 pid: 10268 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580089.494127:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787580089.494132:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787580089.494137:0:6707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a6998ca/0xc86deac208338349 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d376 expref: 9 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580089.494170:0:6707:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008ae60863/0xc86deac208338342 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d36f expref: 9 pid: 10268 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580089.494185:0:6707:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008ae60863/0xc86deac208338342 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d36f expref: 9 pid: 10268 timeout: 537 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580089.494199:0:6707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7f5b8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6707:1874413262810880:192.168.202.36@tcp:104: 00000100:00100000:3.0:1787580089.494285:0:6707:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae6d67e480 going to sleep for 11 seconds 00000100:00100000:1.0:1787580089.505594:0:6707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7f5b8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6707:1874413262810880:192.168.202.36@tcp:104: 00010000:00010000:1.0:1787580089.505646:0:6707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008a6998ca/0xc86deac208338349 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d376 expref: 9 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580089.505669:0:6707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae5f6d6a00, rc 0) 00000100:00100000:1.0:1787580089.505746:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7e97c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+9:11568:x1874413239745408:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 Request processed in 11712us (11948us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580089.505756:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 53 00000100:00100000:1.0:1787580089.507608:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580089.507758:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239745536 00000100:00100000:0.0:1787580089.507769:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239745536 00010000:00010000:0.0:1787580089.507822:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008ae60863/0xc86deac208338342 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d36f expref: 9 pid: 10268 timeout: 537 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580089.507865:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 71 00000100:00100000:0.0:1787580089.507874:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5f6ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+9:2361:x1874413239745536:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787580089.507893:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787580089.507917:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008ae60863/0xc86deac208338342 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d36f expref: 9 pid: 10268 timeout: 537 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580089.507953:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008ae60863/0xc86deac208338342 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d36f expref: 9 pid: 10268 timeout: 537 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580089.507979:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ae60863/0xc86deac208338342 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d36f expref: 9 pid: 10268 timeout: 537 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580089.507995:0:5838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787580089.507999:0:5838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787580089.508008:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008a6998ca/0xc86deac208338349 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d376 expref: 8 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580089.508019:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a6998ca/0xc86deac208338349 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d376 expref: 8 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580089.508059:0:5838:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008a6998ca/0xc86deac208338349 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d376 expref: 8 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580089.508075:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae74ed2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5838:1874413262811008:192.168.202.36@tcp:105: 00000100:00100000:0.0:1787580089.508163:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae7eec23c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787580089.512914:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae74ed2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5838:1874413262811008:192.168.202.36@tcp:105: 00010000:00010000:2.0:1787580089.512941:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787580089.513000:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5f6ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+8:2361:x1874413239745536:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 5126us (5400us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580089.513013:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 71 00000100:00100000:3.0:1787580089.531156:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580089.531445:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239745664 00000100:00100000:0.0:1787580089.531458:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239745664 00002000:00100000:0.0:1787580089.531520:0:6711:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8fae7f5bb480 x1874413239745664/t0(0) o4->31d1df27-21ab-4c76-bd19-e53fa778bd7e@192.168.202.36@tcp:575/0 lens 504/0 e 0 to 0 dl 1787580100 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787580089.531530:0:6711:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8fae7f5bb480 with x1874413239745664 ext(0->8) 00002000:00010000:0.0:1787580089.531545:0:6711:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8fae7f5bb480 00000100:00100000:0.0:1787580089.531582:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 5 00000100:00100000:0.0:1787580089.531590:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7f5bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+8:2360:x1874413239745664:12345-192.168.202.36@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787580089.532151:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7f5bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+10:2360:x1874413239745664:12345-192.168.202.36@tcp:4:lhsmtool_posix.0 Request processed in 557us (1001us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1787580089.532162:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 5 00002000:00100000:0.0:1787580089.532170:0:6711:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8fae7f5bb480 x1874413239745664/t4294967314(0) o4->31d1df27-21ab-4c76-bd19-e53fa778bd7e@192.168.202.36@tcp:575/0 lens 504/448 e 0 to 0 dl 1787580100 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787580089.532179:0:6711:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8fae7f5bb480 with x1874413239745664 ext(0->8) 00002000:00010000:0.0:1787580089.532183:0:6711:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8fae7f5bb480 00000100:00100000:3.0:1787580089.535011:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580089.535047:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239745792 00000100:00100000:3.0:1787580089.535057:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239745792 00000100:00100000:3.0:1787580089.535111:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 183 00000100:00100000:3.0:1787580089.535266:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7f5b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+64:11568:x1874413239745792:12345-192.168.202.36@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1787580089.630310:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:1.0:1787580089.630349:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000004:00080000:1.0:1787580089.630364:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:1.0:1787580089.630403:0:5874:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8fad43647180 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:1.0:1787580089.630409:0:5874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8fae51c71900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8fad43647a80 00000020:00080000:1.0:1787580089.630412:0:5874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8fae51c71e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8fae6d139800 00000004:00080000:1.0:1787580089.630474:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:0.0:1787580089.631823:0:5885:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:0.0:1787580089.632090:0:5885:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:1.0:1787580089.634012:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5f6fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874413262811136:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787580089.634088:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787580089.634145:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787580089.634153:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5f6fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874413262811264:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787580089.634184:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787580089.634225:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262811136 00000100:00100000:1.0:1787580089.634233:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262811136 00000100:00100000:1.0:1787580089.634289:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262811264 00000100:00100000:1.0:1787580089.634293:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262811264 00000100:00100000:1.0:1787580089.634316:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787580089.634326:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5f6fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1874413262811136:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1787580089.634495:0:6708:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1787580089.634498:0:6708:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787580089 00002000:00010000:1.0:1787580089.634501:0:6708:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787580089.634503:0:6708:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1787580089 -> 1787580089 00002000:00010000:1.0:1787580089.634506:0:6708:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787580089.634543:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5f6fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3317:x1874413262811136:12345-0@lo:2:osp-syn-1-0.0 Request processed in 217us (454us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1787580089.634551:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787580089.634581:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787580089.634588:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d660700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1874413262811264:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787580089.634604:0:6708:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:1.0:1787580089.634629:0:6708:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a8c4eb7, atime: 0x0, ctime: 0x6a8c4eb7, blocks: 0xb 00010000:00010000:1.0:1787580089.634637:0:6708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007523e0d0/0xc86deac208338350 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580089.634655:0:6708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=437s v=(0 0) 00010000:00010000:1.0:1787580089.634659:0:6708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787580089.634665:0:6708:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007523e0d0/0xc86deac208338350 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580089.634680:0:6708:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007523e0d0/0xc86deac208338350 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580089.634690:0:6708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007523e0d0/0xc86deac208338350 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580089.634698:0:6708:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007523e0d0/0xc86deac208338350 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580089.635076:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7f5b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+18:11568:x1874413239745792:12345-192.168.202.36@tcp:44:lhsmtool_posix.0 Request processed in 99810us (100073us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580089.635088:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 183 00010000:00010000:1.0:1787580089.635195:0:6708:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:3.0:1787580089.635446:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1787580089.636099:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8fae5f6fdf80/2, rc 0, transno 4294967315 00000100:00100000:0.0:1787580089.636108:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5f6fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874413262811136:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787580089.636430:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d660700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3315:x1874413262811264:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1840us (2243us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1787580089.636441:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00010000:1.0:1787580089.636464:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787580089.636472:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007523e0d0/0xc86deac208338350 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580089.636491:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae4ca58000 already unused, calling callback (ffffffffc155a230) 00010000:00010000:1.0:1787580089.636496:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007523e0d0/0xc86deac208338350 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580089.636506:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007523e0d0/0xc86deac208338350 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580089.636526:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007523e0d0/0xc86deac208338350 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580089.636535:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007523e0d0/0xc86deac208338350 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580089.636553:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787580089.636555:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787580089.636557:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787580089.646198:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580089.646264:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239745920 00000100:00100000:3.0:1787580089.646280:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239745920 00000100:00100000:3.0:1787580089.646347:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 56 00000100:00100000:3.0:1787580089.646359:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7ec51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+10:2361:x1874413239745920:12345-192.168.202.36@tcp:16:lhsmtool_posix.0 00000004:00080000:0.0:1787580089.649899:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8fae5f6fdc00/2, rc 0, transno 4294967307 00000100:00100000:0.0:1787580089.649917:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5f6fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874413262811264:0@lo:6:osp-syn-0-0.0 00000001:00080000:0.0:1787580089.702428:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000001:00080000:0.0:1787580089.702450:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:3.0:1787580089.704887:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7ec51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+7:2361:x1874413239745920:12345-192.168.202.36@tcp:16:lhsmtool_posix.0 Request processed in 58521us (58691us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580089.704900:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 56 00000100:00100000:2.0:1787580089.713305:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580089.713433:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239746176 00000100:00100000:1.0:1787580089.713447:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239746176 00000100:00100000:1.0:1787580089.713513:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 184 00000100:00100000:1.0:1787580089.713523:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7463bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+18:11568:x1874413239746176:12345-192.168.202.36@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787580089.713585:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787580089.713617:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7400/0xc86deac20833833b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d368 expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580089.713634:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8fae530b1c00) 00010000:00010000:1.0:1787580089.713654:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787580089.713690:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac208338357 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580089.713704:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac208338357 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580089.713715:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac208338357 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787580089.714045:0:5854:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b4bb091c reply state 0000000049a97029 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac208338357 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580089.714057:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787580089.714161:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7463bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+19:11568:x1874413239746176:12345-192.168.202.36@tcp:36:lhsmtool_posix.0 Request processed in 638us (869us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1787580089.714168:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 184 00000100:00100000:2.0:1787580089.720660:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00010000:00010000:1.0:1787580089.721064:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac208338357 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580089.721079:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac208338357 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580089.721086:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac208338357 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580089.721093:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae4ca59200 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:1.0:1787580089.721098:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac208338357 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580089.721106:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac208338357 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580089.721148:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8fae530b1c00) 00010000:00010000:1.0:1787580089.721151:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787580089.721158:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac208338357 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580089.721165:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac208338357 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580089.721276:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239746304 00000100:00100000:0.0:1787580089.721286:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239746304 00000100:00100000:0.0:1787580089.721374:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 57 00000100:00100000:0.0:1787580089.721404:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74638000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+7:2360:x1874413239746304:12345-192.168.202.36@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787580089.721669:0:6707:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1787580089.721673:0:6707:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1787580089 -> 1787580088 00002000:00010000:0.0:1787580089.721676:0:6707:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787580087 00002000:00010000:0.0:1787580089.721678:0:6707:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1787580089 -> 1787580088 00002000:00010000:0.0:1787580089.721681:0:6707:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1787580089.721756:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74638000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+8:2360:x1874413239746304:12345-192.168.202.36@tcp:2:lhsmtool_posix.0 Request processed in 373us (1109us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1787580089.721765:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 57 00000100:00100000:3.0:1787580089.723985:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580089.724064:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239746560 00000100:00100000:2.0:1787580089.724073:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239746560 00000100:00100000:2.0:1787580089.724131:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 185 00000100:00100000:2.0:1787580089.724141:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7ec50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+18:11568:x1874413239746560:12345-192.168.202.36@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787580089.724223:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac20833835e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.724241:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7600/0xc86deac20833831f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d35a expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.724273:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac20833835e lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.724318:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7600/0xc86deac20833831f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d35a expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.724334:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7600/0xc86deac20833831f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d35a expref: 18 pid: 5853 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580089.724350:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae74639880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5852:1874413262811392:192.168.202.36@tcp:104: 00000100:00100000:2.0:1787580089.724471:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae6d747c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787580089.740676:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580089.740711:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239746688 00000100:00100000:2.0:1787580089.740720:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239746688 00010000:00010000:2.0:1787580089.740762:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7600/0xc86deac20833831f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d35a expref: 19 pid: 5853 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580089.740806:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 72 00000100:00100000:2.0:1787580089.740817:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5ff1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+19:2360:x1874413239746688:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787580089.740832:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787580089.740840:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7600/0xc86deac20833831f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d35a expref: 19 pid: 5853 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.740854:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7600/0xc86deac20833831f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d35a expref: 19 pid: 5853 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.740899:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8fae530b1c00) 00010000:00010000:2.0:1787580089.740905:0:5840:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac20833835e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.740915:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac20833835e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.740924:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac20833835e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.740944:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787580089.740992:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5ff1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+19:2360:x1874413239746688:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 176us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580089.741000:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 72 00010000:00010000:3.0:1787580089.741296:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7600/0xc86deac20833831f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d35a expref: 18 pid: 5853 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580089.741314:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae74639880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5852:1874413262811392:192.168.202.36@tcp:104: 00010000:00010000:3.0:1787580089.741337:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac20833835e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580089.741346:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac20833835e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580089.741352:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac20833835e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580089.741417:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac20833835e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580089.741425:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac20833835e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580089.741431:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac20833835e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580089.741436:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db9000 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:3.0:1787580089.741440:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac20833835e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580089.741459:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac20833835e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580089.741469:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8fae530b1c00) 00010000:00010000:3.0:1787580089.741472:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787580089.741476:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac20833835e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580089.741483:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac20833835e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580089.741534:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7ec50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+17:11568:x1874413239746560:12345-192.168.202.36@tcp:55:lhsmtool_posix.0 Request processed in 17395us (17557us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787580089.741544:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 185 00000100:00100000:2.0:1787580089.748759:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580089.748852:0:10268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239746816 00000100:00100000:3.0:1787580089.748864:0:10268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239746816 00000100:00100000:3.0:1787580089.748931:0:10268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 58 00000100:00100000:3.0:1787580089.748941:0:10268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5ff1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+8:2361:x1874413239746816:12345-192.168.202.36@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787580089.748989:0:10268:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a4c0f800/0xc86deac208338365 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580089.749011:0:10268:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008a6998ca/0xc86deac208338349 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d376 expref: 8 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580089.749019:0:10268:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787580089.749023:0:10268:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787580089.749028:0:10268:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a4c0f800/0xc86deac208338365 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580089.749075:0:10268:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008a6998ca/0xc86deac208338349 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d376 expref: 8 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580089.749090:0:10268:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008a6998ca/0xc86deac208338349 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d376 expref: 8 pid: 6707 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580089.749105:0:10268:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae74639880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10268:1874413262811520:192.168.202.36@tcp:104: 00000100:00100000:3.0:1787580089.749192:0:10268:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae6d67ec00 going to sleep for 11 seconds 00000100:00100000:3.0:1787580089.757114:0:10268:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae74639880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10268:1874413262811520:192.168.202.36@tcp:104: 00010000:00010000:3.0:1787580089.757152:0:10268:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a4c0f800/0xc86deac208338365 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580089.760299:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580089.760453:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239746944 00000100:00100000:3.0:1787580089.760466:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239746944 00010000:00010000:3.0:1787580089.760513:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008a6998ca/0xc86deac208338349 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d376 expref: 9 pid: 6707 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580089.760566:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 73 00000100:00100000:3.0:1787580089.760577:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5ff1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+9:2360:x1874413239746944:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787580089.760595:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787580089.760621:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008a6998ca/0xc86deac208338349 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d376 expref: 9 pid: 6707 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580089.760635:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008a6998ca/0xc86deac208338349 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d376 expref: 9 pid: 6707 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580089.760680:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008a6998ca/0xc86deac208338349 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d376 expref: 9 pid: 6707 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580089.760699:0:5838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787580089.760703:0:5838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787580089.760709:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a4c0f800/0xc86deac208338365 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580089.760719:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a4c0f800/0xc86deac208338365 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580089.760754:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787580089.760830:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5ff1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+8:2360:x1874413239746944:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 254us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580089.760838:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 73 00010000:00010000:1.0:1787580089.760997:0:10268:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a4c0f800/0xc86deac208338365 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580089.761007:0:10268:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a4c0f800/0xc86deac208338365 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580089.761035:0:10268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a4c0f800/0xc86deac208338365 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580089.761044:0:10268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a4c0f800/0xc86deac208338365 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580089.761052:0:10268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a4c0f800/0xc86deac208338365 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580089.761060:0:10268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae5f6d6600 already unused, calling callback (ffffffffc155a230) 00010000:00010000:1.0:1787580089.761064:0:10268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4c0f800/0xc86deac208338365 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580089.761088:0:10268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4c0f800/0xc86deac208338365 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580089.761103:0:10268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a4c0f800/0xc86deac208338365 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580089.761111:0:10268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a4c0f800/0xc86deac208338365 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580089.761177:0:10268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5ff1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+7:2361:x1874413239746816:12345-192.168.202.36@tcp:1:lhsmtool_posix.0 Request processed in 12237us (12431us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580089.761186:0:10268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 58 00000100:00100000:2.0:1787580089.764442:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580089.764536:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239747200 00000100:00100000:3.0:1787580089.764548:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239747200 00000100:00100000:3.0:1787580089.764608:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 186 00000100:00100000:3.0:1787580089.764628:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5ff1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+17:11568:x1874413239747200:12345-192.168.202.36@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787580089.764725:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7600/0xc86deac20833836c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580089.764744:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7600/0xc86deac20833836c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580089.764757:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7600/0xc86deac20833836c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580089.765049:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6800/0xc86deac208338373 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580089.765061:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea800/0xc86deac20833832d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d361 expref: 18 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580089.765070:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6800/0xc86deac208338373 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580089.765105:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea800/0xc86deac20833832d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d361 expref: 18 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580089.765119:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea800/0xc86deac20833832d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d361 expref: 18 pid: 5852 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580089.765133:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae74639880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5854:1874413262811648:192.168.202.36@tcp:104: 00000100:00100000:3.0:1787580089.765206:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae6d67ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1787580089.768864:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae74639880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5854:1874413262811648:192.168.202.36@tcp:104: 00010000:00010000:0.0:1787580089.768895:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6800/0xc86deac208338373 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580089.770161:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580089.774269:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239747328 00000100:00100000:0.0:1787580089.774291:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239747328 00010000:00010000:0.0:1787580089.774352:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea800/0xc86deac20833832d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d361 expref: 19 pid: 5852 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580089.774420:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 74 00000100:00100000:0.0:1787580089.774431:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74639880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+19:2360:x1874413239747328:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787580089.774448:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787580089.774455:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea800/0xc86deac20833832d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d361 expref: 19 pid: 5852 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580089.774468:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea800/0xc86deac20833832d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d361 expref: 19 pid: 5852 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580089.774504:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea800/0xc86deac20833832d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d361 expref: 19 pid: 5852 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580089.774530:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8fae530b1c00) 00010000:00010000:0.0:1787580089.774536:0:5839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6800/0xc86deac208338373 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580089.774546:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6800/0xc86deac208338373 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580089.774554:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6800/0xc86deac208338373 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580089.774581:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787580089.774651:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74639880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+18:2360:x1874413239747328:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 221us (4494us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580089.774659:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 74 00010000:00010000:0.0:1787580089.774809:0:5854:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6800/0xc86deac208338373 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580089.774818:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6800/0xc86deac208338373 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787580089.775021:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:0.0:1787580089.775183:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:0.0:1787580089.775228:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:0.0:1787580089.775311:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae74ed0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5854:1874413262811776:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787580089.775362:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580089.775413:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fad43647540 going to sleep for 11 seconds 00000100:00100000:0.0:1787580089.775443:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262811776 00000100:00100000:0.0:1787580089.775448:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262811776 00000100:00100000:0.0:1787580089.775481:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787580089.775489:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74ed0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5854:x1874413262811776:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787580089.775560:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74ed0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5854:x1874413262811776:12345-0@lo:1000:mdt00_002.0 Request processed in 72us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580089.775567:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787580089.775600:0:5854:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:0.0:1787580089.775607:0:5854:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8fae5f6fdf80, transno 4294967315 00000100:00100000:0.0:1787580089.775620:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae74ed0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5854:1874413262811776:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1787580089.776058:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:0.0:1787580089.776110:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae74ed0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5854:1874413262811904:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787580089.776143:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580089.776162:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae779f3d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787580089.776179:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262811904 00000100:00100000:0.0:1787580089.776183:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262811904 00000100:00100000:0.0:1787580089.776208:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787580089.776214:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74ed3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5854:x1874413262811904:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787580089.776356:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74ed3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5854:x1874413262811904:12345-0@lo:1000:mdt00_002.0 Request processed in 142us (212us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1787580089.776364:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787580089.776418:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae74ed0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5854:1874413262811904:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1787580089.776446:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6800/0xc86deac208338373 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580089.776455:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6800/0xc86deac208338373 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580089.776471:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6800/0xc86deac208338373 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580089.776478:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae5f6d6800 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:0.0:1787580089.776483:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6800/0xc86deac208338373 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580089.776492:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6800/0xc86deac208338373 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580089.776508:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8fae530b1c00) 00010000:00010000:0.0:1787580089.776511:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787580089.776516:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6800/0xc86deac208338373 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580089.776522:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6800/0xc86deac208338373 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580089.776554:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac2083382a8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580089.776560:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac2083382a8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580089.776566:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac2083382a8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580089.776571:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db8200 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:0.0:1787580089.776574:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac2083382a8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580089.776588:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac2083382a8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580089.776595:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8fae4c7d9b00) 00010000:00010000:0.0:1787580089.776598:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787580089.776601:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac2083382a8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580089.776606:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac2083382a8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580089.776626:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac20833837a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580089.776640:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9400/0xc86deac2083382c4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d345 expref: 21 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580089.776649:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac20833837a lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580089.776672:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9400/0xc86deac2083382c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d345 expref: 21 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580089.776687:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9400/0xc86deac2083382c4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d345 expref: 21 pid: 8897 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580089.776697:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae74ed2680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5854:1874413262812032:192.168.202.36@tcp:104: 00000100:00100000:0.0:1787580089.776753:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae5333b180 going to sleep for 11 seconds 00000100:00100000:0.0:1787580089.801580:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580089.801710:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239747456 00000100:00100000:2.0:1787580089.801732:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239747456 00010000:00010000:2.0:1787580089.801778:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9400/0xc86deac2083382c4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d345 expref: 22 pid: 8897 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580089.801897:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae74ed2680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5854:1874413262812032:192.168.202.36@tcp:104: 00010000:00010000:1.0:1787580089.801924:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac20833837a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580089.805139:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 75 00000100:00100000:2.0:1787580089.805159:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74ed2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+22:2360:x1874413239747456:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787580089.805182:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787580089.805194:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9400/0xc86deac2083382c4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d345 expref: 22 pid: 8897 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.805226:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9400/0xc86deac2083382c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d345 expref: 22 pid: 8897 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.805252:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9400/0xc86deac2083382c4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d345 expref: 22 pid: 8897 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.805264:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8fae4c7d9b00) 00010000:00010000:2.0:1787580089.805269:0:5840:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac20833837a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.805278:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac20833837a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.805285:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac20833837a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580089.805321:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787580089.805402:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74ed2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+21:2360:x1874413239747456:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 232us (3815us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580089.805410:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 75 00010000:00010000:1.0:1787580089.806783:0:5854:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac20833837a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580089.806808:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac20833837a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580089.806821:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac20833837a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580089.806828:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac20833837a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580089.806854:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac20833837a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580089.806860:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae50feb600 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:1.0:1787580089.806864:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac20833837a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580089.806872:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac20833837a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580089.806886:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8fae4c7d9b00) 00010000:00010000:1.0:1787580089.806889:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787580089.806893:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac20833837a lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580089.806899:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac20833837a lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580089.806911:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7600/0xc86deac20833836c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580089.806916:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7600/0xc86deac20833836c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580089.806921:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7600/0xc86deac20833836c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580089.806926:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae5f6d7600 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:1.0:1787580089.806928:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7600/0xc86deac20833836c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580089.806942:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7600/0xc86deac20833836c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580089.806950:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8fae4c7d9b00) 00010000:00010000:1.0:1787580089.806952:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787580089.806955:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7600/0xc86deac20833836c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580089.806960:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7600/0xc86deac20833836c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580089.807202:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5ff1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+20:11568:x1874413239747200:12345-192.168.202.36@tcp:57:lhsmtool_posix.0 Request processed in 42581us (42767us total) trans 4294967466 rc 0/0 00000100:00100000:1.0:1787580089.807213:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 186 00000020:00080000:1.0:1787580089.807218:0:5854:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1787580089.807461:0:11700:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787580089.807466:0:11700:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787580089.808460:0:11700:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:3.0:1787580089.808474:0:11700:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787580089.816654:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580089.818064:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239747712 00000100:00100000:0.0:1787580089.818079:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239747712 00000100:00100000:0.0:1787580089.818156:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 50 00000100:00100000:0.0:1787580089.818167:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51886450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+20:11568:x1874413239747712:12345-192.168.202.36@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787580089.818903:0:5856:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787580089.819007:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:0.0:1787580089.819058:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea800/0xc86deac208338381 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580089.819078:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea800/0xc86deac208338381 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580089.819092:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea800/0xc86deac208338381 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580089.819101:0:5856:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea800/0xc86deac208338381 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580089.819109:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea800/0xc86deac208338381 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580089.819117:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea800/0xc86deac208338381 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580089.819146:0:5856:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787580089.819263:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51886450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+22:11568:x1874413239747712:12345-192.168.202.36@tcp:35:lhsmtool_posix.0 Request processed in 1095us (2618us total) trans 4294967468 rc 0/0 00000100:00100000:0.0:1787580089.819274:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 50 00000020:00080000:0.0:1787580089.819279:0:5856:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787580089.822867:0:7643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787580089.822880:0:7643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea800/0xc86deac208338381 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580089.822893:0:7643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae50fea800 already unused, calling callback (ffffffffc155a230) 00010000:00010000:1.0:1787580089.822898:0:7643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea800/0xc86deac208338381 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580089.822909:0:7643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea800/0xc86deac208338381 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580089.822929:0:7643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8fae56e35e00) 00010000:00010000:1.0:1787580089.822933:0:7643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787580089.822945:0:7643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea800/0xc86deac208338381 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580089.822952:0:7643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea800/0xc86deac208338381 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580089.822974:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787580089.822976:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787580089.822978:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787580089.845012:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787580089.972011:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5ff1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3315:1874413262812160:0@lo:400:kworker.0 00000100:00100000:0.0:1787580089.972105:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580089.972251:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae4527bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874413262812544:0@lo:400:kworker.0 00000100:00100000:3.0:1787580089.972283:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580089.972329:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5ff1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874413262812288:0@lo:400:kworker.0 00000100:00100000:3.0:1787580089.972353:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580089.972379:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787580089.972404:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae4527a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874413262812416:0@lo:400:kworker.0 00000100:00100000:3.0:1787580089.972425:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580089.972453:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262812544 00000100:00100000:3.0:1787580089.972460:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262812544 00000100:00100000:3.0:1787580089.972505:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262812288 00000100:00100000:3.0:1787580089.972508:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262812288 00000100:00100000:3.0:1787580089.972517:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262812416 00000100:00100000:3.0:1787580089.972519:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262812416 00000100:00100000:3.0:1787580089.972533:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1787580089.972541:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74638700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874413262812544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787580089.972586:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74638700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874413262812544:12345-0@lo:400:kworker.0 Request processed in 45us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580089.972593:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1787580089.972608:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1787580089.972613:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae77aab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874413262812288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787580089.972641:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae77aab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874413262812288:12345-0@lo:400:kworker.0 Request processed in 27us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580089.972647:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1787580089.972657:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1787580089.972663:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae77aabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874413262812416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787580089.972687:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae77aabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874413262812416:12345-0@lo:400:kworker.0 Request processed in 24us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580089.972693:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00080000:3.0:1787580089.972707:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787580089.972737:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae4527bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874413262812544:0@lo:400:kworker.0 00000100:00100000:3.0:1787580089.972762:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae4527a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874413262812416:0@lo:400:kworker.0 00000100:00100000:3.0:1787580089.972779:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5ff1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874413262812288:0@lo:400:kworker.0 00000100:00100000:1.0:1787580089.972862:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262812160 00000100:00100000:1.0:1787580089.972867:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262812160 00000100:00100000:1.0:1787580089.972899:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1787580089.972907:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:3315:x1874413262812160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787580089.973273:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:3315:x1874413262812160:12345-0@lo:400:kworker.0 Request processed in 366us (1167us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580089.973281:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1787580089.973372:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5ff1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3315:1874413262812160:0@lo:400:kworker.0 00000040:00080000:2.0:1787580090.210282:0:12536:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787580090.210294:0:12536:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787580090.210331:0:12536:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1787580090.210337:0:12536:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787580090.381411:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580090.381555:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239747968 00000100:00100000:3.0:1787580090.381567:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239747968 00000100:00100000:3.0:1787580090.381640:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 187 00000100:00100000:3.0:1787580090.381652:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74ed2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+22:11587:x1874413239747968:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:3.0:1787580090.381677:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787580090.381697:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6a00/0xc86deac208338388 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d37d expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580090.382168:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7c00/0xc86deac20833838f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580090.382184:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7c00/0xc86deac20833838f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580090.382198:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7c00/0xc86deac20833838f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787580090.382210:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:3.0:1787580090.382377:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6a00/0xc86deac208338388 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d37d expref: 25 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580090.382470:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7c00/0xc86deac20833838f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d37d expref: 24 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580090.382481:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8fae4c7d9800) 00010000:00010000:3.0:1787580090.382485:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787580090.382488:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae5f6d7c00, rc 0) 00000100:00100000:3.0:1787580090.382601:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74ed2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+24:11587:x1874413239747968:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 950us (1226us total) trans 4294967469 rc 0/0 00000100:00100000:3.0:1787580090.382619:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 187 00000100:00100000:0.0:1787580090.398572:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580090.403565:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239748096 00000100:00100000:1.0:1787580090.403581:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239748096 00000100:00100000:1.0:1787580090.403755:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 188 00000100:00100000:1.0:1787580090.403768:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae504b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+24:11587:x1874413239748096:12345-192.168.202.36@tcp:34:lfs.0 00010000:00010000:1.0:1787580090.403865:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac20833839d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580090.403885:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac20833839d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580090.403896:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac20833839d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580090.403912:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58600/0xc86deac2083383a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580090.403928:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58600/0xc86deac2083383a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580090.403936:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58600/0xc86deac2083383a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580090.404219:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58000/0xc86deac2083383ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580090.404227:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58000/0xc86deac2083383ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580090.404233:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58000/0xc86deac2083383ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787580090.404275:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58000/0xc86deac2083383ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580090.404286:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac20833839d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580090.404293:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac20833839d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580090.404299:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac20833839d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580090.404305:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae4ca59200 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:1.0:1787580090.404310:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac20833839d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580090.404317:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac20833839d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580090.404336:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8fae4c7d9800) 00010000:00010000:1.0:1787580090.404339:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787580090.404344:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac20833839d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580090.404350:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac20833839d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580090.404362:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58600/0xc86deac2083383a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580090.404367:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58600/0xc86deac2083383a4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580090.404372:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58600/0xc86deac2083383a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580090.404377:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae4ca58600 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:1.0:1787580090.404380:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58600/0xc86deac2083383a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580090.404419:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58600/0xc86deac2083383a4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580090.404426:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8fae5bb2f300) 00010000:00010000:1.0:1787580090.404428:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787580090.404432:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58600/0xc86deac2083383a4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580090.404438:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58600/0xc86deac2083383a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580090.404463:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58000/0xc86deac2083383ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580090.404469:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58000/0xc86deac2083383ab lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580090.404475:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58000/0xc86deac2083383ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580090.404480:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae4ca58000 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:1.0:1787580090.404483:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58000/0xc86deac2083383ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580090.404488:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58000/0xc86deac2083383ab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580090.404495:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8fae5bb2f700) 00010000:00010000:1.0:1787580090.404498:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787580090.404500:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58000/0xc86deac2083383ab lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580090.404506:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58000/0xc86deac2083383ab lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580090.404595:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae504b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+24:11587:x1874413239748096:12345-192.168.202.36@tcp:34:lfs.0 Request processed in 829us (6034us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580090.404604:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 188 00000100:00100000:3.0:1787580090.457519:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580090.457558:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239748352 00000100:00100000:3.0:1787580090.457567:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239748352 00000100:00100000:3.0:1787580090.457633:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 189 00000100:00100000:3.0:1787580090.457644:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae77aab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+24:11590:x1874413239748352:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:3.0:1787580090.457666:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787580090.457686:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6a00/0xc86deac2083383b2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d384 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580090.457767:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7200/0xc86deac2083383b9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580090.457782:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7200/0xc86deac2083383b9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580090.457801:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7200/0xc86deac2083383b9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580090.457816:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6400/0xc86deac2083383c0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580090.457824:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6400/0xc86deac2083383c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580090.457831:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6400/0xc86deac2083383c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580090.458198:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7a00/0xc86deac2083383c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580090.458212:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7a00/0xc86deac2083383c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580090.458220:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7a00/0xc86deac2083383c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787580090.458230:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1787580090.458320:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7200/0xc86deac2083383b9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580090.458327:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7200/0xc86deac2083383b9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580090.458333:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7200/0xc86deac2083383b9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580090.458339:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae5f6d7200 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:3.0:1787580090.458343:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7200/0xc86deac2083383b9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580090.458351:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7200/0xc86deac2083383b9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580090.458363:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8fae4c7d9800) 00010000:00010000:3.0:1787580090.458366:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787580090.458371:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7200/0xc86deac2083383b9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580090.458376:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7200/0xc86deac2083383b9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580090.458407:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6400/0xc86deac2083383c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580090.458420:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6400/0xc86deac2083383c0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580090.458426:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6400/0xc86deac2083383c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580090.458430:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae5f6d6400 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:3.0:1787580090.458433:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6400/0xc86deac2083383c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580090.458439:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6400/0xc86deac2083383c0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580090.458447:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8fae530b1e00) 00010000:00010000:3.0:1787580090.458449:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787580090.458452:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6400/0xc86deac2083383c0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580090.458458:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6400/0xc86deac2083383c0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580090.458499:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6a00/0xc86deac2083383b2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d384 expref: 27 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580090.458513:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7a00/0xc86deac2083383c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d384 expref: 26 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580090.458520:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8fae530b1100) 00010000:00010000:3.0:1787580090.458522:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787580090.458529:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae5f6d7a00, rc 0) 00000100:00100000:3.0:1787580090.458593:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae77aab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+26:11590:x1874413239748352:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 950us (1083us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1787580090.458601:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 189 00000100:00100000:2.0:1787580090.467817:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580090.467901:0:8897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239748480 00000100:00100000:0.0:1787580090.467911:0:8897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239748480 00000100:00100000:0.0:1787580090.467974:0:8897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 190 00000100:00100000:0.0:1787580090.467985:0:8897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae45279500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+26:11590:x1874413239748480:12345-192.168.202.36@tcp:54:lfs.0 00010000:00010000:0.0:1787580090.468059:0:8897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb800/0xc86deac2083383d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580090.468076:0:8897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb800/0xc86deac2083383d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580090.468088:0:8897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb800/0xc86deac2083383d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580090.468113:0:8897:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb800/0xc86deac2083383d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580090.468120:0:8897:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb800/0xc86deac2083383d5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580090.468127:0:8897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb800/0xc86deac2083383d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580090.468132:0:8897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae50feb800 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:0.0:1787580090.468137:0:8897:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb800/0xc86deac2083383d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580090.468160:0:8897:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb800/0xc86deac2083383d5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580090.468171:0:8897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8fae530b1100) 00010000:00010000:0.0:1787580090.468174:0:8897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787580090.468179:0:8897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb800/0xc86deac2083383d5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580090.468185:0:8897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb800/0xc86deac2083383d5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580090.468255:0:8897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae45279500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+26:11590:x1874413239748480:12345-192.168.202.36@tcp:54:lfs.0 Request processed in 272us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580090.468262:0:8897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 190 00000100:00100000:3.0:1787580090.470315:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580090.470444:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239748736 00000100:00100000:0.0:1787580090.470453:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239748736 00000100:00100000:0.0:1787580090.470500:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 51 00000100:00100000:0.0:1787580090.470510:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae77aaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+26:11590:x1874413239748736:12345-192.168.202.36@tcp:35:lfs.0 00000100:00100000:0.0:1787580090.470817:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae77aaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+27:11590:x1874413239748736:12345-192.168.202.36@tcp:35:lfs.0 Request processed in 307us (508us total) trans 4294967471 rc 0/0 00000100:00100000:0.0:1787580090.470825:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 51 00000100:00100000:3.0:1787580090.483896:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787580090.483926:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae779b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874413262812672:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787580090.483998:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580090.484108:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262812672 00000100:00100000:0.0:1787580090.484119:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262812672 00000100:00100000:0.0:1787580090.484180:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787580090.484192:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae77aa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1874413262812672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787580090.484219:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:0.0:1787580090.484282:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae77aa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1874413262812672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580090.484303:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787580090.484369:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae779b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874413262812672:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787580090.499335:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580090.499504:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239748992 00000100:00100000:0.0:1787580090.499514:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239748992 00000100:00100000:0.0:1787580090.499609:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 191 00000100:00100000:0.0:1787580090.499622:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae45278a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+27:11124:x1874413239748992:12345-192.168.202.36@tcp:101:bash.0 00010000:00010000:0.0:1787580090.499646:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787580090.499667:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb800/0xc86deac2083383dc lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d38b expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580090.499777:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb000/0xc86deac2083383e3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580090.499801:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7a00/0xc86deac2083383c7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d384 expref: 28 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580090.499810:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb000/0xc86deac2083383e3 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580090.499848:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7a00/0xc86deac2083383c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d384 expref: 28 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580090.499872:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7a00/0xc86deac2083383c7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d384 expref: 28 pid: 5854 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580090.499888:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae779b8380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5852:1874413262812800:192.168.202.36@tcp:104: 00000100:00100000:0.0:1787580090.499996:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae49ebd480 going to sleep for 11 seconds 00000100:00100000:2.0:1787580090.510005:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580090.510150:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae779b8380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5852:1874413262812800:192.168.202.36@tcp:104: 00010000:00010000:0.0:1787580090.510193:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb000/0xc86deac2083383e3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580090.511648:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239749120 00000100:00100000:1.0:1787580090.511663:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239749120 00010000:00010000:1.0:1787580090.511708:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7a00/0xc86deac2083383c7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d384 expref: 29 pid: 5854 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580090.511768:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 76 00000100:00100000:1.0:1787580090.511778:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48d86450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+29:2361:x1874413239749120:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787580090.511803:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787580090.511810:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7a00/0xc86deac2083383c7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d384 expref: 29 pid: 5854 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580090.511823:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7a00/0xc86deac2083383c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d384 expref: 29 pid: 5854 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580090.511844:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7a00/0xc86deac2083383c7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d384 expref: 29 pid: 5854 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580090.512052:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8fae530b1100) 00010000:00010000:1.0:1787580090.512060:0:5838:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb000/0xc86deac2083383e3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580090.512071:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb000/0xc86deac2083383e3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580090.512079:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb000/0xc86deac2083383e3 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580090.512112:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787580090.512175:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48d86450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+28:2361:x1874413239749120:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 397us (2316us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580090.512184:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 76 00010000:00010000:0.0:1787580090.512603:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb000/0xc86deac2083383e3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580090.512623:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb000/0xc86deac2083383e3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787580090.512644:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1787580090.513059:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb800/0xc86deac2083383dc lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d38b expref: 29 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580090.513079:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb000/0xc86deac2083383e3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d38b expref: 28 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580090.513087:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8fae530b1100) 00010000:00010000:0.0:1787580090.513090:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787580090.513093:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae50feb000, rc 0) 00000100:00100000:0.0:1787580090.513144:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae45278a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+28:11124:x1874413239748992:12345-192.168.202.36@tcp:101:bash.0 Request processed in 13525us (13821us total) trans 4294967472 rc 0/0 00000100:00100000:0.0:1787580090.513152:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 191 00000100:00100000:2.0:1787580090.516184:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580090.516270:0:8897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239749376 00000100:00100000:0.0:1787580090.516282:0:8897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239749376 00000100:00100000:0.0:1787580090.516345:0:8897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 192 00000100:00100000:0.0:1787580090.516356:0:8897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae4527ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+28:11124:x1874413239749376:12345-192.168.202.36@tcp:36:bash.0 00010000:00010000:0.0:1787580090.516668:0:8897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feac00/0xc86deac2083383f1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580090.516704:0:8897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feac00/0xc86deac2083383f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580090.516714:0:8897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feac00/0xc86deac2083383f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787580090.516768:0:8897:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:0.0:1787580090.516805:0:8897:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006c730a2b reply state 000000006fddc8f3 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feac00/0xc86deac2083383f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580090.516814:0:8897:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1787580090.517063:0:8897:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:0.0:1787580090.517166:0:8897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae4527ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+32:11124:x1874413239749376:12345-192.168.202.36@tcp:36:bash.0 Request processed in 811us (995us total) trans 4294967475 rc 0/0 00000100:00100000:0.0:1787580090.517174:0:8897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 192 00000020:00080000:0.0:1787580090.517179:0:8897:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:2.0:1787580090.518998:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feac00/0xc86deac2083383f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580090.519015:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feac00/0xc86deac2083383f1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580090.519022:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feac00/0xc86deac2083383f1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580090.519028:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae50feac00 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:2.0:1787580090.519033:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feac00/0xc86deac2083383f1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580090.519041:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feac00/0xc86deac2083383f1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580090.519057:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8fae530b1100) 00010000:00010000:2.0:1787580090.519060:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787580090.519065:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feac00/0xc86deac2083383f1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580090.519071:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feac00/0xc86deac2083383f1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580090.519641:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580090.519711:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239749504 00000100:00100000:3.0:1787580090.519721:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239749504 00000100:00100000:3.0:1787580090.519769:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 193 00000100:00100000:3.0:1787580090.519778:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae4527b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+31:11124:x1874413239749504:12345-192.168.202.36@tcp:101:bash.0 00010000:00010000:3.0:1787580090.519811:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787580090.519829:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6a00/0xc86deac2083383f8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d392 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580090.519892:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6a00/0xc86deac2083383f8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d392 expref: 32 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580090.519905:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6a00/0xc86deac2083383f8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d392 expref: 32 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580090.519922:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8fae530b1100) 00010000:00010000:3.0:1787580090.519925:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787580090.519927:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae5f6d6a00, rc 0) 00000100:00100000:3.0:1787580090.519981:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae4527b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+32:11124:x1874413239749504:12345-192.168.202.36@tcp:101:bash.0 Request processed in 204us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580090.519988:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 193 00000100:00100000:1.0:1787580090.521826:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580090.522082:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239749632 00000100:00100000:0.0:1787580090.522092:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239749632 00000100:00100000:0.0:1787580090.522133:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 59 00000100:00100000:0.0:1787580090.522140:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d663b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+7:11124:x1874413239749632:12345-192.168.202.36@tcp:101:bash.0 00010000:00010000:0.0:1787580090.522156:0:6708:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787580090.522170:0:6708:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008492248e/0xc86deac2083383ff lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d399 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787580090.522189:0:6708:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a8c4eb8, atime: 0x6a8c4eb7, ctime: 0x6a8c4eb8, blocks: 0xb 00010000:00010000:0.0:1787580090.522204:0:6708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=438s v=(0 0) 00010000:00010000:0.0:1787580090.522207:0:6708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787580090.522213:0:6708:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008492248e/0xc86deac2083383ff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d399 expref: 8 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580090.522231:0:6708:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008492248e/0xc86deac2083383ff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d399 expref: 8 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580090.522240:0:6708:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae50fea400, rc 0) 00000100:00100000:0.0:1787580090.522348:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d663b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+8:11124:x1874413239749632:12345-192.168.202.36@tcp:101:bash.0 Request processed in 207us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580090.522356:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 59 00000100:00100000:2.0:1787580090.527656:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580090.527866:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239749760 00000100:00100000:3.0:1787580090.527877:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239749760 00002000:00010000:3.0:1787580090.527922:0:6712:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:3.0:1787580090.527926:0:6712:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8fae4527aa00 with x1874413239749760 ext(0->18446744073709551615) 00002000:00010000:3.0:1787580090.527937:0:6712:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8fae4527aa00. 00000100:00100000:3.0:1787580090.527964:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 6 00000100:00100000:3.0:1787580090.527976:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae4527aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+8:2360:x1874413239749760:12345-192.168.202.36@tcp:10:bash.0 00002000:00010000:3.0:1787580090.528220:0:6712:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1787580090.528223:0:6712:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1787580088 -> 1787580090 00002000:00010000:3.0:1787580090.528225:0:6712:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1787580087 -> 1787580087 00002000:00010000:3.0:1787580090.528227:0:6712:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1787580088 -> 1787580090 00002000:00010000:3.0:1787580090.528228:0:6712:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1787580090.528278:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae4527aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+9:2360:x1874413239749760:12345-192.168.202.36@tcp:10:bash.0 Request processed in 305us (635us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1787580090.528285:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 6 00002000:00010000:3.0:1787580090.528288:0:6712:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:3.0:1787580090.528291:0:6712:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8fae4527aa00 with x1874413239749760 ext(0->18446744073709551615) 00002000:00010000:3.0:1787580090.528295:0:6712:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8fae4527aa00. 00000100:00100000:2.0:1787580090.599750:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580090.599977:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239749888 00000100:00100000:1.0:1787580090.599987:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239749888 00000100:00100000:1.0:1787580090.600038:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 194 00000100:00100000:1.0:1787580090.600045:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae4527a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+32:11604:x1874413239749888:12345-192.168.202.36@tcp:34:lfs.0 00010000:00010000:1.0:1787580090.600114:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58200/0xc86deac208338406 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580090.600129:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58200/0xc86deac208338406 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580090.600137:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58200/0xc86deac208338406 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580090.600147:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58a00/0xc86deac20833840d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580090.600152:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58a00/0xc86deac20833840d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580090.600156:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58a00/0xc86deac20833840d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580090.600531:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac208338414 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580090.600538:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac208338414 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580090.600543:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac208338414 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787580090.600579:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac208338414 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580090.600592:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58200/0xc86deac208338406 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580090.600596:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58200/0xc86deac208338406 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580090.600601:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58200/0xc86deac208338406 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580090.600604:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae4ca58200 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:1.0:1787580090.600608:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58200/0xc86deac208338406 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580090.600612:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58200/0xc86deac208338406 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580090.600621:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8fae4c7d9800) 00010000:00010000:1.0:1787580090.600623:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787580090.600626:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58200/0xc86deac208338406 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580090.600631:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58200/0xc86deac208338406 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580090.600639:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58a00/0xc86deac20833840d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580090.600642:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58a00/0xc86deac20833840d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580090.600646:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58a00/0xc86deac20833840d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580090.600652:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae4ca58a00 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:1.0:1787580090.600654:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58a00/0xc86deac20833840d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580090.600658:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58a00/0xc86deac20833840d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580090.600661:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8fae5bb2f700) 00010000:00010000:1.0:1787580090.600663:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787580090.600664:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58a00/0xc86deac20833840d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580090.600667:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58a00/0xc86deac20833840d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580090.600679:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac208338414 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580090.600684:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac208338414 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580090.600689:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac208338414 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580090.600693:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae4ca59200 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:1.0:1787580090.600695:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac208338414 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580090.600701:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac208338414 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580090.600717:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8fae530b1100) 00010000:00010000:1.0:1787580090.600719:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787580090.600723:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac208338414 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580090.600729:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac208338414 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580090.600924:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae4527a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+32:11604:x1874413239749888:12345-192.168.202.36@tcp:34:lfs.0 Request processed in 876us (1181us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580090.600932:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 194 00000100:00100000:1.0:1787580090.648452:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580090.648520:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239750144 00000100:00100000:3.0:1787580090.648528:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239750144 00000100:00100000:3.0:1787580090.648579:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 195 00000100:00100000:3.0:1787580090.648587:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d660e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+32:11607:x1874413239750144:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:3.0:1787580090.648604:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787580090.648628:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6400/0xc86deac20833841b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d3a0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580090.648713:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7200/0xc86deac208338422 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580090.648728:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7200/0xc86deac208338422 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580090.648739:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7200/0xc86deac208338422 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580090.648754:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7600/0xc86deac208338429 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580090.648761:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7600/0xc86deac208338429 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580090.648769:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7600/0xc86deac208338429 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580090.649088:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6800/0xc86deac208338430 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580090.649096:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6800/0xc86deac208338430 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580090.649100:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6800/0xc86deac208338430 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787580090.649107:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1787580090.649175:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7200/0xc86deac208338422 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580090.649181:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7200/0xc86deac208338422 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580090.649189:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7200/0xc86deac208338422 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580090.649194:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae5f6d7200 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:3.0:1787580090.649197:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7200/0xc86deac208338422 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580090.649202:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7200/0xc86deac208338422 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580090.649211:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8fae4c7d9800) 00010000:00010000:3.0:1787580090.649213:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787580090.649216:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7200/0xc86deac208338422 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580090.649220:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7200/0xc86deac208338422 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580090.649229:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7600/0xc86deac208338429 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580090.649232:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7600/0xc86deac208338429 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580090.649236:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7600/0xc86deac208338429 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580090.649239:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae5f6d7600 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:3.0:1787580090.649241:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7600/0xc86deac208338429 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580090.649250:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7600/0xc86deac208338429 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580090.649254:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8fae530b1e00) 00010000:00010000:3.0:1787580090.649255:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787580090.649257:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7600/0xc86deac208338429 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580090.649260:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7600/0xc86deac208338429 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580090.649287:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6400/0xc86deac20833841b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d3a0 expref: 35 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580090.649295:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6800/0xc86deac208338430 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d3a0 expref: 34 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580090.649300:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8fae530b1100) 00010000:00010000:3.0:1787580090.649301:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787580090.649302:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae5f6d6800, rc 0) 00000100:00100000:3.0:1787580090.649364:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d660e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+34:11607:x1874413239750144:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 778us (921us total) trans 4294967476 rc 0/0 00000100:00100000:3.0:1787580090.649369:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 195 00000100:00100000:2.0:1787580090.652737:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580090.652884:0:8897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239750272 00000100:00100000:0.0:1787580090.652897:0:8897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239750272 00000100:00100000:0.0:1787580090.652961:0:8897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 196 00000100:00100000:0.0:1787580090.652971:0:8897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae4527bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+34:11607:x1874413239750272:12345-192.168.202.36@tcp:54:lfs.0 00010000:00010000:0.0:1787580090.653037:0:8897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb800/0xc86deac20833843e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580090.653050:0:8897:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb000/0xc86deac2083383e3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d38b expref: 34 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580090.653057:0:8897:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb800/0xc86deac20833843e lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580090.653085:0:8897:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb000/0xc86deac2083383e3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d38b expref: 34 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580090.653094:0:8897:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb000/0xc86deac2083383e3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d38b expref: 34 pid: 5852 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580090.653119:0:8897:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae779b8380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8897:1874413262812928:192.168.202.36@tcp:104: 00000100:00100000:0.0:1787580090.653194:0:8897:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae49ebd480 going to sleep for 11 seconds 00000100:00100000:2.0:1787580090.656823:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580090.656938:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239750528 00000100:00100000:3.0:1787580090.656949:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239750528 00000100:00100000:3.0:1787580090.657006:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 52 00000100:00100000:3.0:1787580090.657013:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7f35fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+35:5600:x1874413239750528:12345-192.168.202.36@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787580090.657464:0:8897:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae779b8380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8897:1874413262812928:192.168.202.36@tcp:104: 00010000:00010000:0.0:1787580090.657485:0:8897:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb800/0xc86deac20833843e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580090.657634:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7f35fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+36:5600:x1874413239750528:12345-192.168.202.36@tcp:35:ldlm_bl.0 Request processed in 620us (824us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1787580090.657641:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 52 00000100:00100000:3.0:1787580090.663664:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580090.663859:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239750656 00000100:00100000:0.0:1787580090.663873:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239750656 00010000:00010000:0.0:1787580090.663921:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb000/0xc86deac2083383e3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d38b expref: 36 pid: 5852 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580090.663967:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 77 00000100:00100000:0.0:1787580090.663978:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae77aa9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+36:2360:x1874413239750656:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787580090.664006:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787580090.664015:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb000/0xc86deac2083383e3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d38b expref: 36 pid: 5852 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580090.664029:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb000/0xc86deac2083383e3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d38b expref: 36 pid: 5852 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580090.664050:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb000/0xc86deac2083383e3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d38b expref: 36 pid: 5852 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580090.664067:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8fae530b1100) 00010000:00010000:0.0:1787580090.664072:0:5839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb800/0xc86deac20833843e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580090.664095:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb800/0xc86deac20833843e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580090.664104:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb800/0xc86deac20833843e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580090.664139:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787580090.664200:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae77aa9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+35:2360:x1874413239750656:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 223us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580090.664208:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 77 00010000:00010000:1.0:1787580090.664633:0:8897:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb800/0xc86deac20833843e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580090.664643:0:8897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb800/0xc86deac20833843e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580090.664685:0:8897:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb800/0xc86deac20833843e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580090.664692:0:8897:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb800/0xc86deac20833843e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580090.664700:0:8897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb800/0xc86deac20833843e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580090.664705:0:8897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae50feb800 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:1.0:1787580090.664710:0:8897:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb800/0xc86deac20833843e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580090.664732:0:8897:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb800/0xc86deac20833843e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580090.664742:0:8897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8fae530b1100) 00010000:00010000:1.0:1787580090.664746:0:8897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787580090.664750:0:8897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb800/0xc86deac20833843e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580090.664756:0:8897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb800/0xc86deac20833843e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580090.664866:0:8897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae4527bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+34:11607:x1874413239750272:12345-192.168.202.36@tcp:54:lfs.0 Request processed in 11888us (12140us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580090.664876:0:8897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 196 00000100:00100000:3.0:1787580090.666619:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580090.666679:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239750912 00000100:00100000:2.0:1787580090.666701:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239750912 00000100:00100000:2.0:1787580090.666801:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 53 00000100:00100000:2.0:1787580090.666812:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae77aa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+34:11607:x1874413239750912:12345-192.168.202.36@tcp:35:lfs.0 00000100:00100000:2.0:1787580090.667064:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae77aa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+35:11607:x1874413239750912:12345-192.168.202.36@tcp:35:lfs.0 Request processed in 251us (446us total) trans 4294967478 rc 0/0 00000100:00100000:2.0:1787580090.667072:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 53 00000100:00100000:2.0:1787580090.789794:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580090.789885:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239751168 00000100:00100000:3.0:1787580090.789894:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239751168 00000100:00100000:3.0:1787580090.789958:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 197 00000100:00100000:3.0:1787580090.789969:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7f35e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+35:11618:x1874413239751168:12345-192.168.202.36@tcp:101:cat.0 00010000:00010000:3.0:1787580090.789994:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787580090.790013:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6600/0xc86deac208338445 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d3a7 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580090.790085:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6400/0xc86deac20833844c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580090.790099:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6400/0xc86deac20833844c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580090.790111:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6400/0xc86deac20833844c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580090.790126:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7600/0xc86deac208338453 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580090.790133:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7600/0xc86deac208338453 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580090.790139:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7600/0xc86deac208338453 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580090.790720:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7200/0xc86deac20833845a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580090.790731:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7200/0xc86deac20833845a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580090.790740:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7200/0xc86deac20833845a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787580090.790751:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:3.0:1787580090.790866:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6400/0xc86deac20833844c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580090.790874:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6400/0xc86deac20833844c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580090.790883:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6400/0xc86deac20833844c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580090.790889:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae5f6d6400 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:3.0:1787580090.790894:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6400/0xc86deac20833844c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580090.790901:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6400/0xc86deac20833844c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580090.790914:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8fae4c7d9800) 00010000:00010000:3.0:1787580090.790917:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787580090.790921:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6400/0xc86deac20833844c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580090.790938:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6400/0xc86deac20833844c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580090.790952:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7600/0xc86deac208338453 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580090.790958:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7600/0xc86deac208338453 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580090.790963:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7600/0xc86deac208338453 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580090.790967:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae5f6d7600 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:3.0:1787580090.790970:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7600/0xc86deac208338453 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580090.790976:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7600/0xc86deac208338453 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580090.790983:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8fae530b1e00) 00010000:00010000:3.0:1787580090.790986:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787580090.790989:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7600/0xc86deac208338453 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580090.790996:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7600/0xc86deac208338453 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580090.791045:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6600/0xc86deac208338445 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d3a7 expref: 38 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580090.791059:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7200/0xc86deac20833845a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d3a7 expref: 37 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580090.791071:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8fae530b1100) 00010000:00010000:3.0:1787580090.791074:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787580090.791077:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae5f6d7200, rc 0) 00000100:00100000:3.0:1787580090.791213:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7f35e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+37:11618:x1874413239751168:12345-192.168.202.36@tcp:101:cat.0 Request processed in 1244us (1435us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1787580090.791221:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 197 00000100:00100000:3.0:1787580090.803591:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580090.803840:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239751424 00000100:00100000:0.0:1787580090.803853:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239751424 00000100:00100000:0.0:1787580090.803918:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 54 00000100:00100000:0.0:1787580090.803930:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae77aa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+37:11618:x1874413239751424:12345-192.168.202.36@tcp:35:cat.0 00000100:00100000:0.0:1787580090.804202:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae77aa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+38:11618:x1874413239751424:12345-192.168.202.36@tcp:35:cat.0 Request processed in 274us (624us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1787580090.804211:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 54 00000100:00100000:1.0:1787580090.824878:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580090.824923:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580090.824955:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580090.824988:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580090.825020:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239751936 00000100:00100000:1.0:1787580090.825028:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239751936 00000100:00100000:1.0:1787580090.825084:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 168 00000100:00100000:1.0:1787580090.825093:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74f01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d66e8ae-0b45-4a46-9f01-8e93d52be8ea+5:2358:x1874413239751936:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:1.0:1787580090.825169:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74f01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d66e8ae-0b45-4a46-9f01-8e93d52be8ea+5:2358:x1874413239751936:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 77us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580090.825177:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 168 00000100:00080000:1.0:1787580090.825198:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787580090.825491:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239751808 00000100:00100000:2.0:1787580090.825497:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239751808 00000100:00100000:2.0:1787580090.825536:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239751680 00000100:00100000:2.0:1787580090.825540:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239751680 00000100:00100000:2.0:1787580090.825567:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 82 00000100:00100000:2.0:1787580090.825575:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d662680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+9:2358:x1874413239751808:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:2.0:1787580090.825621:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d662680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+9:2358:x1874413239751808:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 47us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580090.825628:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 82 00000100:00100000:2.0:1787580090.825641:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 83 00000100:00100000:2.0:1787580090.825648:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d661880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+5:2358:x1874413239751680:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:2.0:1787580090.825671:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d661880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+5:2358:x1874413239751680:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 24us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580090.825677:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 83 00000100:00100000:3.0:1787580090.825829:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239751552 00000100:00100000:3.0:1787580090.825834:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239751552 00000100:00100000:3.0:1787580090.825872:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 303 00000100:00100000:3.0:1787580090.825880:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ff68ada-0c43-4367-93b7-ad31684360cf+13:2358:x1874413239751552:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:3.0:1787580090.825910:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ff68ada-0c43-4367-93b7-ad31684360cf+13:2358:x1874413239751552:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 32us (1044us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580090.825916:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 303 00000100:00080000:1.0:1787580090.826229:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787580090.839235:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580090.839342:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239752192 00000100:00100000:0.0:1787580090.839352:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239752192 00000100:00100000:0.0:1787580090.839457:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 198 00000100:00100000:0.0:1787580090.839468:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74639880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+38:11619:x1874413239752192:12345-192.168.202.36@tcp:36:rm.0 00010000:00010000:0.0:1787580090.839540:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787580090.839571:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7200/0xc86deac20833845a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d3a7 expref: 38 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580090.839593:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6800/0xc86deac208338430 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d3a0 expref: 37 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580090.839631:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6a00/0xc86deac2083383f8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d392 expref: 36 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580090.839641:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8fae530b1100) 00010000:00010000:0.0:1787580090.839652:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787580090.839676:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb000/0xc86deac208338468 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580090.839690:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb000/0xc86deac208338468 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580090.839699:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb000/0xc86deac208338468 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580090.839723:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea000/0xc86deac20833846f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580090.839730:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea000/0xc86deac20833846f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580090.839738:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea000/0xc86deac20833846f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580090.840073:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feaa00/0xc86deac208338476 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580090.840082:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feaa00/0xc86deac208338476 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580090.840089:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feaa00/0xc86deac208338476 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787580090.841155:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:0.0:1787580090.841168:0:5852:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 438596784321ns, next at 439596781294ns, rc = 0 00010000:00010000:0.0:1787580090.841239:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb800/0xc86deac20833847d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580090.841251:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb800/0xc86deac20833847d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580090.841261:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb800/0xc86deac20833847d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580090.841268:0:5852:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb800/0xc86deac20833847d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580090.841274:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb800/0xc86deac20833847d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580090.841279:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb800/0xc86deac20833847d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580090.841687:0:5852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787580090.841778:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feaa00/0xc86deac208338476 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580090.841795:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feaa00/0xc86deac208338476 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580090.841802:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feaa00/0xc86deac208338476 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580090.841810:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae50feaa00 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:0.0:1787580090.841826:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feaa00/0xc86deac208338476 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580090.841835:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feaa00/0xc86deac208338476 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580090.841847:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8fae56e35600) 00010000:00010000:0.0:1787580090.841850:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787580090.841857:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feaa00/0xc86deac208338476 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580090.841863:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feaa00/0xc86deac208338476 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580090.841884:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb000/0xc86deac208338468 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580090.841890:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb000/0xc86deac208338468 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580090.841895:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb000/0xc86deac208338468 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580090.841900:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae50feb000 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:0.0:1787580090.841903:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb000/0xc86deac208338468 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580090.841909:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb000/0xc86deac208338468 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580090.841917:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8fae4c7d9800) 00010000:00010000:0.0:1787580090.841919:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787580090.841928:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb000/0xc86deac208338468 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580090.841934:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb000/0xc86deac208338468 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787580090.841945:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009ed8c874 reply state 0000000092595528 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea000/0xc86deac20833846f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580090.841954:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787580090.842059:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74639880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+37:11619:x1874413239752192:12345-192.168.202.36@tcp:36:rm.0 Request processed in 2589us (2834us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1787580090.842068:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 198 00010000:00010000:0.0:1787580090.846995:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea000/0xc86deac20833846f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580090.847017:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea000/0xc86deac20833846f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580090.847026:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea000/0xc86deac20833846f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580090.847033:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae50fea000 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:0.0:1787580090.847038:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea000/0xc86deac20833846f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580090.847046:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea000/0xc86deac20833846f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580090.847065:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8fae56e35a00) 00010000:00010000:0.0:1787580090.847068:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787580090.847073:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea000/0xc86deac20833846f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580090.847097:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea000/0xc86deac20833846f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580090.847186:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787580090.847193:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb800/0xc86deac20833847d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580090.847199:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae50feb800 already unused, calling callback (ffffffffc155a230) 00010000:00010000:1.0:1787580090.847203:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb800/0xc86deac20833847d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580090.847209:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb800/0xc86deac20833847d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580090.847217:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8fae56e35600) 00010000:00010000:1.0:1787580090.847220:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787580090.847223:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb800/0xc86deac20833847d lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580090.847228:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb800/0xc86deac20833847d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580090.847241:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787580090.847243:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787580090.847244:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787580090.867869:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787580090.934296:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580090.935884:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239752448 00000100:00100000:2.0:1787580090.935901:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239752448 00000100:00100000:2.0:1787580090.935972:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 199 00000100:00100000:2.0:1787580090.935981:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74ed2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+36:11625:x1874413239752448:12345-192.168.202.36@tcp:101:bash.0 00010000:00010000:2.0:1787580090.936004:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787580090.936039:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac208338484 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d3ae expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580090.936168:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac20833848b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580090.936179:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac20833848b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580090.936188:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac20833848b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580090.936197:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8a00/0xc86deac208338492 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580090.936201:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8a00/0xc86deac208338492 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580090.936205:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8a00/0xc86deac208338492 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787580090.936870:0:5853:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:2.0:1787580090.937069:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac208338499 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580090.937077:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac208338499 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580090.937083:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac208338499 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580090.937115:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac20833848b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580090.937132:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac20833848b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580090.937138:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac20833848b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580090.937144:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db9000 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:2.0:1787580090.937149:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac20833848b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580090.937156:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac20833848b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580090.937168:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8fae4c7d9800) 00010000:00010000:2.0:1787580090.937170:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787580090.937174:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac20833848b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580090.937179:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac20833848b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787580090.937191:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000058e717d6 reply state 000000003368a2b1 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8a00/0xc86deac208338492 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580090.937200:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787580090.937227:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac208338484 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d3ae expref: 39 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580090.937240:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac208338499 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d3ae expref: 38 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580090.937258:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8fae4c7d9e00) 00010000:00010000:2.0:1787580090.937260:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787580090.937263:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae48db8800, rc 0) 00000100:00100000:2.0:1787580090.937952:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74ed2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+39:11625:x1874413239752448:12345-192.168.202.36@tcp:101:bash.0 Request processed in 1967us (3661us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1787580090.937962:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 199 00010000:00010000:3.0:1787580090.942194:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8a00/0xc86deac208338492 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580090.942208:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8a00/0xc86deac208338492 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580090.942213:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8a00/0xc86deac208338492 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580090.942216:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db8a00 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:3.0:1787580090.942219:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8a00/0xc86deac208338492 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580090.942239:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8a00/0xc86deac208338492 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580090.942254:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8fae4c7d9500) 00010000:00010000:3.0:1787580090.942255:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787580090.942259:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8a00/0xc86deac208338492 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580090.942263:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8a00/0xc86deac208338492 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580090.946779:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580090.947073:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239752576 00000100:00100000:3.0:1787580090.947086:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239752576 00000100:00100000:3.0:1787580090.947153:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 60 00000100:00100000:3.0:1787580090.947163:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5f6ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+5:2361:x1874413239752576:12345-192.168.202.36@tcp:101:bash.0 00010000:00010000:3.0:1787580090.947186:0:6705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787580090.947213:0:6705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a4c0f800/0xc86deac2083384a7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d3b5 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787580090.947249:0:6705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787580090.947275:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=438s v=(0 0) 00010000:00010000:3.0:1787580090.947282:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787580090.947294:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a4c0f800/0xc86deac2083384a7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d3b5 expref: 6 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580090.947324:0:6705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a4c0f800/0xc86deac2083384a7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d3b5 expref: 6 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580090.947361:0:6705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae5f6d6600, rc 0) 00000100:00100000:3.0:1787580090.948209:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5f6ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:2361:x1874413239752576:12345-192.168.202.36@tcp:101:bash.0 Request processed in 288us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580090.948219:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 60 00000100:00100000:2.0:1787580090.954810:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580090.955089:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239752704 00000100:00100000:0.0:1787580090.955101:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239752704 00000100:00100000:0.0:1787580090.955168:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 61 00000100:00100000:0.0:1787580090.955179:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7f35f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:11625:x1874413239752704:12345-192.168.202.36@tcp:101:bash.0 00010000:00010000:0.0:1787580090.955197:0:6708:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787580090.955219:0:6708:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000900bbbb0/0xc86deac2083384ae lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d3bc expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580090.955259:0:6708:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a4c0f800/0xc86deac2083384a7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d3b5 expref: 7 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580090.955268:0:6708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787580090.955273:0:6708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787580090.955278:0:6708:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000900bbbb0/0xc86deac2083384ae lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d3bc expref: 7 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580090.955325:0:6708:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a4c0f800/0xc86deac2083384a7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d3b5 expref: 7 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580090.955339:0:6708:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a4c0f800/0xc86deac2083384a7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d3b5 expref: 7 pid: 6705 timeout: 538 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580090.955354:0:6708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae779b8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6708:1874413262813056:192.168.202.36@tcp:104: 00000100:00100000:0.0:1787580090.955526:0:6708:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae49ebd900 going to sleep for 11 seconds 00000100:00100000:1.0:1787580090.958618:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580090.958776:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239752832 00000100:00100000:3.0:1787580090.958795:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239752832 00010000:00010000:3.0:1787580090.958841:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a4c0f800/0xc86deac2083384a7 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d3b5 expref: 8 pid: 6705 timeout: 538 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580090.958883:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 78 00000100:00100000:3.0:1787580090.958892:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5f6fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+8:2361:x1874413239752832:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787580090.958907:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787580090.958930:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a4c0f800/0xc86deac2083384a7 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d3b5 expref: 8 pid: 6705 timeout: 538 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580090.958941:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a4c0f800/0xc86deac2083384a7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d3b5 expref: 8 pid: 6705 timeout: 538 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580090.958960:0:5838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787580090.958964:0:5838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787580090.958971:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000900bbbb0/0xc86deac2083384ae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d3bc expref: 8 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580090.958981:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000900bbbb0/0xc86deac2083384ae lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d3bc expref: 8 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580090.959037:0:5838:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000900bbbb0/0xc86deac2083384ae lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d3bc expref: 8 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580090.959049:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae77aaaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5838:1874413262813184:192.168.202.36@tcp:105: 00000100:00100000:3.0:1787580090.959121:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae6d67ec00 going to sleep for 11 seconds 00010000:00010000:0.0:1787580090.959659:0:6708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a4c0f800/0xc86deac2083384a7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d3b5 expref: 8 pid: 6705 timeout: 538 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580090.959833:0:6708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae779b8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6708:1874413262813056:192.168.202.36@tcp:104: 00010000:00010000:0.0:1787580090.959917:0:6708:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000900bbbb0/0xc86deac2083384ae lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d3bc expref: 7 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580090.959930:0:6708:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae50fea000, rc 0) 00000100:00100000:0.0:1787580090.959982:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7f35f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+7:11625:x1874413239752704:12345-192.168.202.36@tcp:101:bash.0 Request processed in 4804us (5200us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580090.959992:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 61 00000100:00100000:1.0:1787580090.964336:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580090.964545:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239753088 00000100:00100000:0.0:1787580090.964557:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239753088 00000100:00100000:0.0:1787580090.964626:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 55 00000100:00100000:0.0:1787580090.964638:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae77a88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+38:11625:x1874413239753088:12345-192.168.202.36@tcp:35:bash.0 00000100:00100000:0.0:1787580090.965189:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae77a88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+39:11625:x1874413239753088:12345-192.168.202.36@tcp:35:bash.0 Request processed in 551us (860us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1787580090.965198:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 55 00000100:00100000:3.0:1787580090.965725:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae77aaaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5838:1874413262813184:192.168.202.36@tcp:105: 00010000:00010000:3.0:1787580090.965916:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787580090.965961:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5f6fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:2361:x1874413239752832:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 7067us (7357us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580090.965971:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 78 00000100:00100000:1.0:1787580091.158272:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580091.158413:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239753216 00000100:00100000:3.0:1787580091.158422:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239753216 00000100:00100000:3.0:1787580091.158510:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 200 00000100:00100000:3.0:1787580091.158523:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae77a88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+39:11641:x1874413239753216:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:3.0:1787580091.158555:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787580091.158579:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7600/0xc86deac2083384b5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d3c3 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580091.158649:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6400/0xc86deac2083384bc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580091.158661:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6400/0xc86deac2083384bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580091.158672:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6400/0xc86deac2083384bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787580091.158757:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:3.0:1787580091.158762:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787580091.158797:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6400/0xc86deac2083384bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580091.158824:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7600/0xc86deac2083384b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d3c3 expref: 41 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580091.158838:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6400/0xc86deac2083384bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d3c3 expref: 40 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580091.158844:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8fae4c7d9800) 00010000:00010000:3.0:1787580091.158846:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787580091.158849:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae5f6d6400, rc 0) 00000100:00080000:0.0:1787580091.159016:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787580091.159093:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae77a88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+40:11641:x1874413239753216:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 574us (830us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580091.159098:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 200 00000100:00100000:1.0:1787580091.163323:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580091.163439:0:8897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239753472 00000100:00100000:2.0:1787580091.163449:0:8897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239753472 00000100:00100000:2.0:1787580091.163508:0:8897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 201 00000100:00100000:2.0:1787580091.163518:0:8897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae77a89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+40:11641:x1874413239753472:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:2.0:1787580091.163536:0:8897:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787580091.163553:0:8897:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac2083384c3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d3ca expref: -99 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580091.163642:0:8897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac2083384ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580091.163652:0:8897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac2083384ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580091.163660:0:8897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac2083384ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787580091.163668:0:8897:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787580091.163813:0:8897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac2083384c3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d3ca expref: 43 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580091.164085:0:8897:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac2083384ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d3ca expref: 42 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580091.164096:0:8897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8fae4c7d9e00) 00010000:00010000:2.0:1787580091.164099:0:8897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787580091.164518:0:8897:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae48db8200, rc 0) 00000100:00100000:2.0:1787580091.164646:0:8897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae77a89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+42:11641:x1874413239753472:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 1125us (1337us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1787580091.164655:0:8897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 201 00000100:00100000:2.0:1787580091.174563:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580091.174719:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580091.175360:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239753856 00000100:00100000:1.0:1787580091.175372:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239753856 00000100:00100000:1.0:1787580091.175480:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 14 00000100:00100000:1.0:1787580091.175492:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d4e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+42:2360:x1874413239753856:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787580091.175509:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787580091.175537:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac2083384ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d3ca expref: 42 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580091.175559:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8fae4c7d9e00) 00010000:00010000:1.0:1787580091.175565:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787580091.175633:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d4e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+41:2360:x1874413239753856:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 143us (914us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580091.175641:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 14 00000100:00100000:0.0:1787580091.178166:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239753728 00000100:00100000:0.0:1787580091.178181:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239753728 00000100:00100000:0.0:1787580091.178290:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 202 00000100:00100000:0.0:1787580091.178301:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7f35dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+41:11641:x1874413239753728:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:0.0:1787580091.178338:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787580091.178375:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb000/0xc86deac2083384d8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d3d1 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580091.178509:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feaa00/0xc86deac2083384df lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580091.178525:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feaa00/0xc86deac2083384df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580091.178536:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feaa00/0xc86deac2083384df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787580091.178548:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1787580091.178695:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb000/0xc86deac2083384d8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d3d1 expref: 44 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580091.178843:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feaa00/0xc86deac2083384df lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d3d1 expref: 43 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580091.178958:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8fae4c7d9e00) 00010000:00010000:0.0:1787580091.178962:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787580091.178966:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae50feaa00, rc 0) 00000100:00100000:0.0:1787580091.179068:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7f35dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+43:11641:x1874413239753728:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 768us (4514us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1787580091.179076:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 202 00000100:00100000:2.0:1787580091.187118:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580091.187202:0:10268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239753984 00000100:00100000:0.0:1787580091.187213:0:10268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239753984 00000100:00100000:0.0:1787580091.187327:0:10268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 62 00000100:00100000:0.0:1787580091.187339:0:10268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d4e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+6:2358:x1874413239753984:12345-192.168.202.36@tcp:1:lfs.0 00010000:00010000:0.0:1787580091.187440:0:10268:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4f39b46/0xc86deac2083384ed lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580091.187465:0:10268:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000900bbbb0/0xc86deac2083384ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d3bc expref: 6 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580091.187474:0:10268:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787580091.187479:0:10268:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787580091.187484:0:10268:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4f39b46/0xc86deac2083384ed lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580091.187521:0:10268:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000900bbbb0/0xc86deac2083384ae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d3bc expref: 6 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580091.187536:0:10268:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000900bbbb0/0xc86deac2083384ae lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d3bc expref: 6 pid: 6708 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580091.187550:0:10268:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae779b8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10268:1874413262813312:192.168.202.36@tcp:104: 00000100:00100000:0.0:1787580091.187648:0:10268:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae49ebd900 going to sleep for 11 seconds 00000100:00100000:1.0:1787580091.193495:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580091.193540:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239754112 00000100:00100000:3.0:1787580091.193550:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239754112 00002000:00100000:3.0:1787580091.193599:0:6713:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8fae77a8bb80 x1874413239754112/t0(0) o4->31d1df27-21ab-4c76-bd19-e53fa778bd7e@192.168.202.36@tcp:577/0 lens 504/0 e 0 to 0 dl 1787580102 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787580091.193610:0:6713:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8fae77a8bb80 with x1874413239754112 ext(0->8) 00010000:00010000:3.0:1787580091.193620:0:6713:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000900bbbb0/0xc86deac2083384ae lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d3bc expref: 7 pid: 6708 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580091.193636:0:6713:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000900bbbb0/0xc86deac2083384ae lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d3bc expref: 7 pid: 6708 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787580091.193661:0:6713:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8fae77a8bb80 00000100:00100000:0.0:1787580091.193678:0:10268:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae779b8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10268:1874413262813312:192.168.202.36@tcp:104: 00010000:00010000:0.0:1787580091.193702:0:10268:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f4f39b46/0xc86deac2083384ed lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580091.193710:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 2 00000100:00100000:3.0:1787580091.193721:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae77a8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+7:2361:x1874413239754112:12345-192.168.202.36@tcp:4:lfs.0 00000100:00100000:3.0:1787580091.194196:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae77a8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+9:2361:x1874413239754112:12345-192.168.202.36@tcp:4:lfs.0 Request processed in 474us (710us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1787580091.194204:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 2 00002000:00100000:3.0:1787580091.194211:0:6713:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8fae77a8bb80 x1874413239754112/t4294967308(0) o4->31d1df27-21ab-4c76-bd19-e53fa778bd7e@192.168.202.36@tcp:577/0 lens 504/448 e 0 to 0 dl 1787580102 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787580091.194219:0:6713:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8fae77a8bb80 with x1874413239754112 ext(0->8) 00010000:00010000:3.0:1787580091.194224:0:6713:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000900bbbb0/0xc86deac2083384ae lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d3bc expref: 9 pid: 6708 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580091.194237:0:6713:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000900bbbb0/0xc86deac2083384ae lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d3bc expref: 9 pid: 6708 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787580091.194244:0:6713:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8fae77a8bb80 00000100:00100000:1.0:1787580091.197771:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580091.198003:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239754240 00000100:00100000:3.0:1787580091.198015:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239754240 00010000:00010000:3.0:1787580091.198059:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000900bbbb0/0xc86deac2083384ae lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d3bc expref: 9 pid: 6708 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580091.198136:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 79 00000100:00100000:3.0:1787580091.198148:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7ec35180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+9:2360:x1874413239754240:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787580091.198174:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787580091.198196:0:5838:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1787580091.198199:0:5838:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787580090 00002000:00010000:3.0:1787580091.198202:0:5838:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787580091 00002000:00010000:3.0:1787580091.198205:0:5838:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1787580090 00010000:00010000:3.0:1787580091.198212:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000900bbbb0/0xc86deac2083384ae lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d3bc expref: 9 pid: 6708 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580091.198227:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000900bbbb0/0xc86deac2083384ae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d3bc expref: 9 pid: 6708 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580091.198251:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000900bbbb0/0xc86deac2083384ae lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d3bc expref: 9 pid: 6708 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580091.198268:0:5838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787580091.198272:0:5838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787580091.198279:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f4f39b46/0xc86deac2083384ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580091.198289:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4f39b46/0xc86deac2083384ed lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580091.198322:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787580091.198416:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7ec35180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+8:2360:x1874413239754240:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 269us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580091.198423:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 79 00010000:00010000:0.0:1787580091.198812:0:10268:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f4f39b46/0xc86deac2083384ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580091.198833:0:10268:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4f39b46/0xc86deac2083384ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580091.198869:0:10268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4f39b46/0xc86deac2083384ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580091.198879:0:10268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4f39b46/0xc86deac2083384ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580091.198887:0:10268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4f39b46/0xc86deac2083384ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580091.198894:0:10268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae50feb000 already unused, calling callback (ffffffffc155a230) 00010000:00010000:0.0:1787580091.198898:0:10268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4f39b46/0xc86deac2083384ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580091.198906:0:10268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4f39b46/0xc86deac2083384ed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580091.198920:0:10268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4f39b46/0xc86deac2083384ed lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580091.198928:0:10268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4f39b46/0xc86deac2083384ed lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580091.198999:0:10268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d4e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+7:2358:x1874413239753984:12345-192.168.202.36@tcp:1:lfs.0 Request processed in 11662us (11892us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580091.199007:0:10268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 62 00000100:00100000:1.0:1787580091.203263:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580091.203351:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239754496 00000100:00100000:0.0:1787580091.203362:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239754496 00000100:00100000:0.0:1787580091.203454:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 56 00000100:00100000:0.0:1787580091.203465:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51883850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+43:11641:x1874413239754496:12345-192.168.202.36@tcp:35:lfs.0 00000004:00010000:0.0:1787580091.203531:0:5856:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feaa00/0xc86deac2083384df lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d3d1 expref: 43 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787580091.203852:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:0.0:1787580091.205146:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:0.0:1787580091.205641:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:0.0:1787580091.206042:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb000/0xc86deac2083384f4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580091.206063:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac208338499 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d3ae expref: 47 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580091.206073:0:5856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb000/0xc86deac2083384f4 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580091.206113:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac208338499 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d3ae expref: 47 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580091.206131:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac208338499 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d3ae expref: 47 pid: 5853 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580091.206168:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae779b8380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5856:1874413262813440:192.168.202.36@tcp:104: 00000100:00100000:0.0:1787580091.206336:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae49ebd900 going to sleep for 11 seconds 00000100:00100000:2.0:1787580091.211073:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580091.211555:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239754624 00000100:00100000:1.0:1787580091.211565:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239754624 00010000:00010000:1.0:1787580091.211617:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac208338499 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d3ae expref: 48 pid: 5853 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580091.211659:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 80 00000100:00100000:1.0:1787580091.211675:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d4e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+48:2360:x1874413239754624:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787580091.211689:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787580091.211696:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac208338499 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d3ae expref: 48 pid: 5853 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580091.211717:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac208338499 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d3ae expref: 48 pid: 5853 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580091.212185:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8fae4c7d9e00) 00010000:00010000:1.0:1787580091.212190:0:5840:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb000/0xc86deac2083384f4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580091.212200:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb000/0xc86deac2083384f4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580091.212208:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb000/0xc86deac2083384f4 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580091.212227:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787580091.212289:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d4e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+48:2360:x1874413239754624:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 621us (1227us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580091.212297:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 80 00010000:00010000:0.0:1787580091.213564:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac208338499 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d3ae expref: 47 pid: 5853 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580091.213586:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae779b8380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5856:1874413262813440:192.168.202.36@tcp:104: 00010000:00010000:0.0:1787580091.213657:0:5856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb000/0xc86deac2083384f4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580091.213831:0:5856:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb000/0xc86deac2083384f4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580091.213838:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb000/0xc86deac2083384f4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787580091.214021:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:0.0:1787580091.214227:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:0.0:1787580091.214343:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae779b8380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5856:1874413262813568:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787580091.214515:0:5856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580091.214557:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae49ebd780 going to sleep for 11 seconds 00000100:00100000:1.0:1787580091.214634:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262813568 00000100:00100000:1.0:1787580091.214641:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262813568 00000100:00100000:1.0:1787580091.214719:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787580091.214738:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5856:x1874413262813568:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787580091.214830:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5856:x1874413262813568:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 103us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580091.214838:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1787580091.214885:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787580091.214913:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae779b8380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5856:1874413262813568:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1787580091.215364:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:0.0:1787580091.215446:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae779b8380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5856:1874413262813696:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787580091.215470:0:5856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580091.215496:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae49ebd900 going to sleep for 11 seconds 00000100:00100000:3.0:1787580091.215516:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262813696 00000100:00100000:3.0:1787580091.215523:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262813696 00000100:00100000:0.0:1787580091.215615:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787580091.215624:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7e97e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5856:x1874413262813696:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787580091.215794:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7e97e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5856:x1874413262813696:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 171us (321us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1787580091.215801:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787580091.216013:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae779b8380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5856:1874413262813696:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787580091.216060:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:2.0:1787580091.216096:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb000/0xc86deac2083384f4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580091.216107:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb000/0xc86deac2083384f4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580091.216113:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb000/0xc86deac2083384f4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580091.216119:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae50feb000 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:2.0:1787580091.216124:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb000/0xc86deac2083384f4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580091.216143:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb000/0xc86deac2083384f4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580091.216160:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8fae4c7d9e00) 00010000:00010000:2.0:1787580091.216163:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787580091.216167:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb000/0xc86deac2083384f4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580091.216173:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb000/0xc86deac2083384f4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787580091.216333:0:5856:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787580091.216459:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:2.0:1787580091.216472:0:5856:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 438972087816ns, next at 439972085405ns, rc = 0 00000001:00080000:2.0:1787580091.216478:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:2.0:1787580091.216507:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8fae4c7d9e00) 00010000:00010000:2.0:1787580091.216510:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787580091.216516:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feaa00/0xc86deac2083384df lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d3d1 expref: 51 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580091.216627:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51883850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+50:11641:x1874413239754496:12345-192.168.202.36@tcp:35:lfs.0 Request processed in 13163us (13375us total) trans 4294967494 rc 0/0 00000100:00100000:2.0:1787580091.216635:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 56 00000020:00080000:2.0:1787580091.216639:0:5856:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1787580091.222232:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580091.222912:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239754752 00000100:00100000:3.0:1787580091.222924:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239754752 00000100:00100000:2.0:1787580091.223090:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 203 00000100:00100000:2.0:1787580091.223102:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d4e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+50:11641:x1874413239754752:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:2.0:1787580091.223126:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787580091.223162:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9800/0xc86deac2083384fb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d3d8 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580091.223225:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9800/0xc86deac2083384fb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d3d8 expref: 51 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580091.223239:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9800/0xc86deac2083384fb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d3d8 expref: 51 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580091.223259:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8fae4c7d9000) 00010000:00010000:2.0:1787580091.223262:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787580091.223266:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae48db9800, rc 0) 00000100:00100000:2.0:1787580091.223347:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d4e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+51:11641:x1874413239754752:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 247us (1125us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580091.223354:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 203 00000100:00100000:3.0:1787580091.227013:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580091.227080:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239755008 00000100:00100000:2.0:1787580091.227090:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239755008 00000100:00100000:2.0:1787580091.227142:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 57 00000100:00100000:2.0:1787580091.227149:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae77aaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+51:11641:x1874413239755008:12345-192.168.202.36@tcp:35:lfs.0 00000100:00100000:2.0:1787580091.227366:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae77aaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+52:11641:x1874413239755008:12345-192.168.202.36@tcp:35:lfs.0 Request processed in 215us (362us total) trans 4294967495 rc 0/0 00000100:00100000:2.0:1787580091.227374:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 57 00000100:00100000:3.0:1787580091.309805:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580091.310775:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239755136 00000100:00100000:2.0:1787580091.310797:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239755136 00000100:00100000:2.0:1787580091.310874:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 204 00000100:00100000:2.0:1787580091.310884:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae77aaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+52:11651:x1874413239755136:12345-192.168.202.36@tcp:34:lfs.0 00010000:00010000:2.0:1787580091.310961:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208338502 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580091.310996:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208338502 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580091.311012:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208338502 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580091.311031:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac208338509 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580091.311036:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac208338509 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580091.311040:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac208338509 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580091.311124:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8400/0xc86deac208338510 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580091.311129:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8400/0xc86deac208338510 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580091.311133:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8400/0xc86deac208338510 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787580091.311168:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8400/0xc86deac208338510 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580091.311178:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208338502 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580091.311182:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208338502 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580091.311194:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208338502 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580091.311199:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db9c00 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:2.0:1787580091.311202:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208338502 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580091.311206:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208338502 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580091.311216:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8fae4c7d9800) 00010000:00010000:2.0:1787580091.311218:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787580091.311222:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208338502 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580091.311227:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208338502 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580091.311237:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac208338509 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580091.311240:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac208338509 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580091.311244:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac208338509 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580091.311247:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db8800 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:2.0:1787580091.311249:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac208338509 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580091.311257:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac208338509 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580091.311262:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8fae4c7d9e00) 00010000:00010000:2.0:1787580091.311263:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787580091.311265:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac208338509 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580091.311268:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac208338509 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580091.311278:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8400/0xc86deac208338510 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580091.311281:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8400/0xc86deac208338510 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580091.311284:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8400/0xc86deac208338510 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580091.311287:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db8400 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:2.0:1787580091.311288:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8400/0xc86deac208338510 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580091.311292:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8400/0xc86deac208338510 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580091.311296:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8fae4c7d9000) 00010000:00010000:2.0:1787580091.311297:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787580091.311298:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8400/0xc86deac208338510 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580091.311307:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8400/0xc86deac208338510 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580091.311439:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae77aaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+52:11651:x1874413239755136:12345-192.168.202.36@tcp:34:lfs.0 Request processed in 554us (1662us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580091.311447:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 204 00000100:00100000:1.0:1787580091.375006:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580091.381077:0:8897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239755392 00000100:00100000:2.0:1787580091.381092:0:8897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239755392 00000100:00100000:2.0:1787580091.381173:0:8897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 205 00000100:00100000:2.0:1787580091.381184:0:8897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7ec36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+52:11654:x1874413239755392:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:2.0:1787580091.381206:0:8897:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787580091.381228:0:8897:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8400/0xc86deac208338517 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d3df expref: -99 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580091.381713:0:8897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac20833851e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580091.381730:0:8897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac20833851e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580091.381742:0:8897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac20833851e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580091.381757:0:8897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208338525 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580091.381764:0:8897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208338525 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580091.381800:0:8897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208338525 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580091.382046:0:8897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9400/0xc86deac20833852c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580091.382054:0:8897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9400/0xc86deac20833852c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580091.382061:0:8897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9400/0xc86deac20833852c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787580091.382071:0:8897:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787580091.382177:0:8897:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac20833851e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580091.382184:0:8897:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac20833851e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580091.382191:0:8897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac20833851e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580091.382197:0:8897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db8800 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:2.0:1787580091.382201:0:8897:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac20833851e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580091.382209:0:8897:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac20833851e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580091.382221:0:8897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8fae4c7d9800) 00010000:00010000:2.0:1787580091.382224:0:8897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787580091.382234:0:8897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac20833851e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580091.382239:0:8897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac20833851e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580091.382252:0:8897:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208338525 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580091.382257:0:8897:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208338525 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580091.382262:0:8897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208338525 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580091.382266:0:8897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db9c00 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:2.0:1787580091.382268:0:8897:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208338525 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580091.382274:0:8897:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208338525 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580091.382281:0:8897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8fae4c7d9e00) 00010000:00010000:2.0:1787580091.382608:0:8897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787580091.382612:0:8897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208338525 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580091.382619:0:8897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208338525 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580091.382675:0:8897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8400/0xc86deac208338517 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d3df expref: 55 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580091.382710:0:8897:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9400/0xc86deac20833852c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d3df expref: 54 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580091.382717:0:8897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8fae4c7d9000) 00010000:00010000:2.0:1787580091.382719:0:8897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787580091.382721:0:8897:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae48db9400, rc 0) 00000100:00100000:2.0:1787580091.382805:0:8897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7ec36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+54:11654:x1874413239755392:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 1622us (7807us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1787580091.382813:0:8897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 205 00000100:00100000:3.0:1787580091.390088:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580091.390156:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239755520 00000100:00100000:2.0:1787580091.390168:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239755520 00000100:00100000:2.0:1787580091.390225:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 206 00000100:00100000:2.0:1787580091.390237:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae77aa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+54:11654:x1874413239755520:12345-192.168.202.36@tcp:54:lfs.0 00010000:00010000:2.0:1787580091.390328:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac20833853a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580091.390346:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac20833853a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580091.390357:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac20833853a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580091.390404:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac20833853a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580091.390411:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac20833853a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580091.390436:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac20833853a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580091.390441:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db9000 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:2.0:1787580091.390446:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac20833853a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580091.390453:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac20833853a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580091.390464:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8fae4c7d9000) 00010000:00010000:2.0:1787580091.390467:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787580091.390472:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac20833853a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580091.390478:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac20833853a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580091.390553:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae77aa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+54:11654:x1874413239755520:12345-192.168.202.36@tcp:54:lfs.0 Request processed in 319us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580091.390562:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 206 00000100:00100000:3.0:1787580091.393329:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580091.394410:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239755776 00000100:00100000:2.0:1787580091.394426:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239755776 00000100:00100000:2.0:1787580091.394486:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 58 00000100:00100000:2.0:1787580091.394497:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae77aa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+54:11654:x1874413239755776:12345-192.168.202.36@tcp:35:lfs.0 00000100:00100000:2.0:1787580091.395445:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae77aa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+55:11654:x1874413239755776:12345-192.168.202.36@tcp:35:lfs.0 Request processed in 944us (2129us total) trans 4294967497 rc 0/0 00000100:00100000:2.0:1787580091.395456:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 58 00000100:00100000:1.0:1787580091.535360:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580091.536104:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239756032 00000100:00100000:0.0:1787580091.536118:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239756032 00000100:00100000:0.0:1787580091.536239:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 207 00000100:00100000:0.0:1787580091.536251:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7ec36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+55:11664:x1874413239756032:12345-192.168.202.36@tcp:101:bash.0 00010000:00010000:0.0:1787580091.536277:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787580091.536280:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787580091.536306:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6400/0xc86deac2083384bc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d3c3 expref: 55 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580091.536333:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8fae4c7d9800) 00010000:00010000:0.0:1787580091.536338:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787580091.536351:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feac00/0xc86deac208338541 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d3e6 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580091.536500:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feae00/0xc86deac208338548 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580091.536515:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feae00/0xc86deac208338548 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580091.536525:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feae00/0xc86deac208338548 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787580091.536536:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1787580091.536706:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feac00/0xc86deac208338541 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d3e6 expref: 57 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580091.536723:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feae00/0xc86deac208338548 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d3e6 expref: 56 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580091.536999:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8fae4c7d9000) 00010000:00010000:0.0:1787580091.537002:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787580091.537005:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae50feae00, rc 0) 00000100:00100000:0.0:1787580091.537085:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7ec36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+56:11664:x1874413239756032:12345-192.168.202.36@tcp:101:bash.0 Request processed in 835us (1780us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1787580091.537094:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 207 00000100:00100000:3.0:1787580091.541356:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580091.542216:0:8897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239756288 00000100:00100000:2.0:1787580091.542232:0:8897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239756288 00000100:00100000:2.0:1787580091.542309:0:8897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 208 00000100:00100000:2.0:1787580091.542322:0:8897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5ff1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+56:11664:x1874413239756288:12345-192.168.202.36@tcp:36:bash.0 00010000:00010000:2.0:1787580091.542403:0:8897:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1787580091.542429:0:8897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feae00/0xc86deac208338548 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d3e6 expref: 56 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580091.542452:0:8897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9400/0xc86deac20833852c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d3df expref: 55 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580091.542465:0:8897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8fae4c7d9000) 00010000:00010000:2.0:1787580091.542470:0:8897:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787580091.543046:0:8897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208338556 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580091.543062:0:8897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208338556 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580091.543072:0:8897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208338556 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787580091.543128:0:8897:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:2.0:1787580091.543156:0:8897:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f4212679 reply state 00000000ca7259f8 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208338556 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580091.543166:0:8897:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787580091.543270:0:8897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5ff1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+57:11664:x1874413239756288:12345-192.168.202.36@tcp:36:bash.0 Request processed in 950us (1926us total) trans 4294967500 rc 0/0 00000100:00100000:2.0:1787580091.543278:0:8897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 208 00000020:00080000:2.0:1787580091.543299:0:8897:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787580091.546679:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208338556 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580091.546702:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208338556 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580091.546711:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208338556 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580091.546717:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db9000 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:0.0:1787580091.546721:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208338556 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580091.547004:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208338556 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580091.547023:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8fae4c7d9000) 00010000:00010000:0.0:1787580091.547026:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787580091.547044:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208338556 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580091.547050:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208338556 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580091.547477:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580091.547609:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239756416 00000100:00100000:1.0:1787580091.547621:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239756416 00000100:00100000:1.0:1787580091.547683:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 209 00000100:00100000:1.0:1787580091.547693:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d4e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+56:11664:x1874413239756416:12345-192.168.202.36@tcp:101:bash.0 00010000:00010000:1.0:1787580091.547740:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787580091.547759:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58000/0xc86deac20833855d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d3ed expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580091.547841:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58600/0xc86deac208338564 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580091.548024:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58600/0xc86deac208338564 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580091.548037:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58600/0xc86deac208338564 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787580091.548065:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1787580091.548069:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787580091.548086:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58600/0xc86deac208338564 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580091.548111:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58000/0xc86deac20833855d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d3ed expref: 58 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580091.548125:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58600/0xc86deac208338564 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d3ed expref: 57 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580091.548133:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8fae4c7d9000) 00010000:00010000:1.0:1787580091.548136:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787580091.548139:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae4ca58600, rc 0) 00000100:00100000:1.0:1787580091.548197:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d4e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+57:11664:x1874413239756416:12345-192.168.202.36@tcp:101:bash.0 Request processed in 505us (724us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580091.548204:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 209 00000100:00100000:2.0:1787580091.552303:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580091.552514:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239756672 00000100:00100000:0.0:1787580091.552527:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239756672 00000100:00100000:0.0:1787580091.552624:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 59 00000100:00100000:0.0:1787580091.552635:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d4e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+57:11664:x1874413239756672:12345-192.168.202.36@tcp:35:bash.0 00000100:00100000:0.0:1787580091.553187:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d4e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+58:11664:x1874413239756672:12345-192.168.202.36@tcp:35:bash.0 Request processed in 552us (892us total) trans 4294967501 rc 0/0 00000100:00100000:0.0:1787580091.553196:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 59 00000100:00100000:2.0:1787580091.645540:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580091.645649:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239756800 00000100:00100000:0.0:1787580091.645671:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239756800 00000100:00100000:0.0:1787580091.645737:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 210 00000100:00100000:0.0:1787580091.645749:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d4e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+58:11670:x1874413239756800:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:0.0:1787580091.645810:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787580091.645836:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feac00/0xc86deac20833856b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d3f4 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580091.645917:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac208338572 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580091.645931:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac208338572 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580091.645940:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac208338572 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787580091.646019:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:0.0:1787580091.646023:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787580091.646047:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac208338572 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580091.646074:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feac00/0xc86deac20833856b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d3f4 expref: 60 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580091.646093:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac208338572 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d3f4 expref: 59 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580091.646102:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8fae4c7d9800) 00010000:00010000:0.0:1787580091.646105:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787580091.646109:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae50feb600, rc 0) 00000100:00100000:0.0:1787580091.646173:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d4e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+59:11670:x1874413239756800:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 426us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580091.646180:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 210 00000100:00100000:3.0:1787580091.653737:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580091.653872:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239756928 00000100:00100000:1.0:1787580091.653884:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239756928 00000100:00100000:1.0:1787580091.653959:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 211 00000100:00100000:1.0:1787580091.653971:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5ff1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+59:11670:x1874413239756928:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:1.0:1787580091.653995:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787580091.654020:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58000/0xc86deac208338579 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d3fb expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580091.654102:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58200/0xc86deac208338580 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580091.654119:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58200/0xc86deac208338580 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580091.654130:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58200/0xc86deac208338580 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580091.654146:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58a00/0xc86deac208338587 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580091.654153:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58a00/0xc86deac208338587 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580091.654159:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58a00/0xc86deac208338587 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580091.654272:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac20833858e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580091.654281:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac20833858e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580091.654309:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac20833858e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787580091.654348:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1787580091.654354:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787580091.654375:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac20833858e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580091.654421:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac20833858e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580091.654431:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58200/0xc86deac208338580 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580091.654437:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58200/0xc86deac208338580 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580091.654445:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58200/0xc86deac208338580 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580091.654451:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae4ca58200 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:1.0:1787580091.654456:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58200/0xc86deac208338580 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580091.654463:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58200/0xc86deac208338580 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580091.654475:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8fae4c7d9800) 00010000:00010000:1.0:1787580091.654478:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787580091.654482:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58200/0xc86deac208338580 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580091.654500:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58200/0xc86deac208338580 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580091.654515:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58a00/0xc86deac208338587 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580091.654520:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58a00/0xc86deac208338587 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580091.654526:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58a00/0xc86deac208338587 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580091.654531:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae4ca58a00 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:1.0:1787580091.654534:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58a00/0xc86deac208338587 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580091.654541:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58a00/0xc86deac208338587 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580091.654548:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8fae5bb2f700) 00010000:00010000:1.0:1787580091.654551:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787580091.654553:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58a00/0xc86deac208338587 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580091.654559:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58a00/0xc86deac208338587 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580091.654588:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58000/0xc86deac208338579 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d3fb expref: 61 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580091.654601:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac20833858e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d3fb expref: 60 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580091.654614:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8fae4c7d9000) 00010000:00010000:1.0:1787580091.654617:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787580091.654619:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae4ca59200, rc 0) 00000100:00100000:1.0:1787580091.654689:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5ff1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+60:11670:x1874413239756928:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 720us (972us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580091.654695:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 211 00000100:00100000:2.0:1787580091.658705:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580091.659249:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239757056 00000100:00100000:3.0:1787580091.659261:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239757056 00000100:00100000:3.0:1787580091.659335:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 15 00000100:00100000:3.0:1787580091.659346:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d4e0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+60:2360:x1874413239757056:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787580091.659363:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787580091.659491:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac20833858e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d3fb expref: 60 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580091.659512:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8fae4c7d9000) 00010000:00010000:3.0:1787580091.659517:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787580091.659949:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d4e0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+59:2360:x1874413239757056:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 603us (1252us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580091.659956:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 15 00000100:00100000:2.0:1787580091.664319:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580091.664568:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239757312 00000100:00100000:0.0:1787580091.664579:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239757312 00000100:00100000:0.0:1787580091.664673:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 212 00000100:00100000:0.0:1787580091.664685:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d4e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+59:11670:x1874413239757312:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:0.0:1787580091.664708:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787580091.664730:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feac00/0xc86deac208338595 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d402 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580091.664869:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea800/0xc86deac20833859c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580091.664886:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58600/0xc86deac208338564 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d3ed expref: 60 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580091.664895:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea800/0xc86deac20833859c lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580091.664931:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58600/0xc86deac208338564 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d3ed expref: 60 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580091.664945:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58600/0xc86deac208338564 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d3ed expref: 60 pid: 5854 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580091.664958:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5f810380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5853:1874413262813824:192.168.202.36@tcp:104: 00000100:00100000:0.0:1787580091.665053:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae50edaf00 going to sleep for 11 seconds 00000100:00100000:0.0:1787580091.668692:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5f810380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5853:1874413262813824:192.168.202.36@tcp:104: 00010000:00010000:0.0:1787580091.668745:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea800/0xc86deac20833859c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580091.669875:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580091.670115:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239757440 00000100:00100000:1.0:1787580091.670125:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239757440 00010000:00010000:1.0:1787580091.670168:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58600/0xc86deac208338564 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d3ed expref: 61 pid: 5854 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580091.670210:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 81 00000100:00100000:1.0:1787580091.670219:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48d87450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+61:2360:x1874413239757440:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787580091.670236:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787580091.670244:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58600/0xc86deac208338564 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d3ed expref: 61 pid: 5854 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580091.670258:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58600/0xc86deac208338564 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d3ed expref: 61 pid: 5854 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580091.670283:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58600/0xc86deac208338564 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d3ed expref: 61 pid: 5854 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580091.670302:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8fae4c7d9000) 00010000:00010000:1.0:1787580091.670307:0:5840:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea800/0xc86deac20833859c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580091.670331:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea800/0xc86deac20833859c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580091.670339:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea800/0xc86deac20833859c lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580091.670370:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787580091.670459:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48d87450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+60:2360:x1874413239757440:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 240us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580091.670467:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 81 00010000:00010000:0.0:1787580091.670585:0:5853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea800/0xc86deac20833859c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580091.670596:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea800/0xc86deac20833859c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787580091.670636:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1787580091.670867:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feac00/0xc86deac208338595 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d402 expref: 61 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580091.670885:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea800/0xc86deac20833859c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d402 expref: 60 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580091.670892:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8fae4c7d9000) 00010000:00010000:0.0:1787580091.670895:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787580091.670898:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae50fea800, rc 0) 00000100:00100000:0.0:1787580091.670928:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d4e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+60:11670:x1874413239757312:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 6245us (6621us total) trans 4294967502 rc 0/0 00000100:00100000:0.0:1787580091.670935:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 212 00000100:00100000:3.0:1787580091.674533:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580091.674661:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239757696 00000100:00100000:0.0:1787580091.674674:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239757696 00000100:00100000:0.0:1787580091.674752:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 16 00000100:00100000:0.0:1787580091.674763:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5ff1f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+60:11670:x1874413239757696:12345-192.168.202.36@tcp:103:lfs.0 00010000:00010000:0.0:1787580091.674791:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787580091.674819:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9800/0xc86deac2083384fb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d3d8 expref: 60 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580091.674839:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8fae4c7d9000) 00010000:00010000:0.0:1787580091.674845:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787580091.675035:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5ff1f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+59:11670:x1874413239757696:12345-192.168.202.36@tcp:103:lfs.0 Request processed in 273us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580091.675042:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 16 00000100:00100000:2.0:1787580091.677592:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580091.677728:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239757824 00000100:00100000:1.0:1787580091.677737:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239757824 00000100:00100000:1.0:1787580091.677798:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 213 00000100:00100000:1.0:1787580091.677807:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d4e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+59:11670:x1874413239757824:12345-192.168.202.36@tcp:58:lfs.0 00010000:00010000:1.0:1787580091.677912:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58600/0xc86deac2083385aa lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580091.677929:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58600/0xc86deac2083385aa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580091.677941:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58600/0xc86deac2083385aa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787580091.678134:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:1.0:1787580091.678221:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d4e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+59:11670:x1874413239757824:12345-192.168.202.36@tcp:58:lfs.0 Request processed in 415us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580091.678228:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 213 00000100:00100000:2.0:1787580091.684713:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580091.684959:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239757952 00000100:00100000:3.0:1787580091.684971:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239757952 00000100:00100000:3.0:1787580091.685040:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 214 00000100:00100000:3.0:1787580091.685052:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d4e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+59:11670:x1874413239757952:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:3.0:1787580091.685079:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787580091.685104:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7400/0xc86deac2083385b1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d409 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580091.685197:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58600/0xc86deac2083385aa lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580091.685209:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7400/0xc86deac2083385b1 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d409 expref: 60 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580091.685229:0:5852:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58600/0xc86deac2083385aa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580091.685243:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7400/0xc86deac2083385b1 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d409 expref: 60 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580091.685257:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8fae4c7d9000) 00010000:00010000:3.0:1787580091.685260:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787580091.685265:0:5852:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7400/0xc86deac2083385b1 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d409 expref: 60 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580091.685272:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae5f6d7400, rc 0) 00000100:00100000:3.0:1787580091.685337:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d4e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+60:11670:x1874413239757952:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 286us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580091.685345:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 214 00000040:00080000:3.0:1787580091.891754:0:11700:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787580091.891766:0:11700:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787580091.891819:0:11700:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1787580091.891829:0:11700:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787580091.891962:0:11700:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5ff1d500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11700:1874413262813952:192.168.202.36@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787580091.892064:0:11700:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae6d67ed80 going to sleep for 11 seconds 00010000:00010000:1.0:1787580091.893076:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787580091.895726:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580091.895838:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239758080 00000100:00100000:1.0:1787580091.895863:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239758080 00000100:00100000:1.0:1787580091.895928:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 215 00000100:00100000:1.0:1787580091.896049:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d4e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+61:11672:x1874413239758080:12345-192.168.202.36@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787580091.896086:0:5854:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787580091.896279:0:11700:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5ff1d500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11700:1874413262813952:192.168.202.36@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787580091.896509:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d4e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+60:11672:x1874413239758080:12345-192.168.202.36@tcp:53:lhsmtool_posix.0 Request processed in 463us (794us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580091.896518:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 215 00000100:00100000:2.0:1787580091.908286:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580091.908879:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239758208 00000100:00100000:3.0:1787580091.908891:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239758208 00000100:00100000:3.0:1787580091.908955:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 216 00000100:00100000:3.0:1787580091.908966:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d4e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+60:11672:x1874413239758208:12345-192.168.202.36@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787580091.909041:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7600/0xc86deac2083385b8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580091.909059:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7600/0xc86deac2083385b8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580091.909070:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7600/0xc86deac2083385b8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580091.909086:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6200/0xc86deac2083385bf lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580091.909093:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6200/0xc86deac2083385bf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580091.909099:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6200/0xc86deac2083385bf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580091.909119:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6000/0xc86deac2083385c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580091.909127:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6000/0xc86deac2083385c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580091.909133:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6000/0xc86deac2083385c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787580091.909188:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1787580091.909192:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787580091.909204:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6000/0xc86deac2083385c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580091.909215:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7600/0xc86deac2083385b8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580091.909221:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7600/0xc86deac2083385b8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580091.909227:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7600/0xc86deac2083385b8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580091.909232:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae5f6d7600 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:3.0:1787580091.909235:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7600/0xc86deac2083385b8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580091.909242:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7600/0xc86deac2083385b8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580091.909254:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8fae5bb2f000) 00010000:00010000:3.0:1787580091.909257:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787580091.909262:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7600/0xc86deac2083385b8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580091.909268:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7600/0xc86deac2083385b8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580091.909280:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6200/0xc86deac2083385bf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580091.909295:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6200/0xc86deac2083385bf lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580091.909302:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6200/0xc86deac2083385bf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580091.909307:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae5f6d6200 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:3.0:1787580091.909310:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6200/0xc86deac2083385bf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580091.909316:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6200/0xc86deac2083385bf lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580091.909324:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff8fae530b1e00) 00010000:00010000:3.0:1787580091.909327:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787580091.909330:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6200/0xc86deac2083385bf lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580091.909335:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6200/0xc86deac2083385bf lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580091.909351:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6000/0xc86deac2083385c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580091.909358:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6000/0xc86deac2083385c6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580091.909363:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6000/0xc86deac2083385c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580091.909367:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae5f6d6000 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:3.0:1787580091.909376:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6000/0xc86deac2083385c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580091.909435:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6000/0xc86deac2083385c6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580091.909444:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8fae4c7d9000) 00010000:00010000:3.0:1787580091.909446:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787580091.909449:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6000/0xc86deac2083385c6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580091.909455:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6000/0xc86deac2083385c6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580091.909535:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d4e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+60:11672:x1874413239758208:12345-192.168.202.36@tcp:34:lhsmtool_posix.0 Request processed in 570us (1261us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580091.909543:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 216 00000100:00100000:2.0:1787580091.912103:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580091.912190:0:8897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239758464 00000100:00100000:3.0:1787580091.912200:0:8897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239758464 00000100:00100000:3.0:1787580091.912304:0:8897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 217 00000100:00100000:3.0:1787580091.912325:0:8897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d4e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+60:11672:x1874413239758464:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787580091.912349:0:8897:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787580091.912375:0:8897:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6e00/0xc86deac2083385cd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d410 expref: -99 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580091.912531:0:8897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7000/0xc86deac2083385d4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580091.912547:0:8897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7000/0xc86deac2083385d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580091.912576:0:8897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7000/0xc86deac2083385d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787580091.912589:0:8897:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1787580091.912693:0:8897:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7000/0xc86deac2083385d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580091.912701:0:8897:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7000/0xc86deac2083385d4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580091.912707:0:8897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7000/0xc86deac2083385d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580091.912713:0:8897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae5f6d7000 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:3.0:1787580091.912717:0:8897:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7000/0xc86deac2083385d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580091.912724:0:8897:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7000/0xc86deac2083385d4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580091.912736:0:8897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8fae4c7d9000) 00010000:00010000:3.0:1787580091.912739:0:8897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787580091.912743:0:8897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7000/0xc86deac2083385d4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580091.912749:0:8897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7000/0xc86deac2083385d4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580091.912796:0:8897:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6e00/0xc86deac2083385cd lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d410 expref: 62 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580091.912817:0:8897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8fae5bb2f000) 00010000:00010000:3.0:1787580091.912819:0:8897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787580091.912824:0:8897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6e00/0xc86deac2083385cd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d410 expref: 62 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580091.912833:0:8897:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae5f6d6e00, rc 0) 00000100:00100000:3.0:1787580091.912895:0:8897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d4e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+61:11672:x1874413239758464:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 Request processed in 572us (803us total) trans 4294967503 rc 301/301 00000100:00100000:3.0:1787580091.912903:0:8897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 217 00000100:00100000:0.0:1787580091.923995:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580091.924057:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239758592 00000100:00100000:1.0:1787580091.924067:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239758592 00000100:00100000:1.0:1787580091.924160:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 218 00000100:00100000:1.0:1787580091.924171:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5f810380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+61:11672:x1874413239758592:12345-192.168.202.36@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787580091.924213:0:5853:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787580091.924338:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5f810380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+61:11672:x1874413239758592:12345-192.168.202.36@tcp:53:lhsmtool_posix.0 Request processed in 168us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580091.924346:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 218 00000100:00100000:2.0:1787580091.933503:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580091.933989:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239758848 00000100:00100000:3.0:1787580091.934000:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239758848 00000100:00100000:3.0:1787580091.934107:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 219 00000100:00100000:3.0:1787580091.934120:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d4e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+61:11672:x1874413239758848:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787580091.934143:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787580091.934146:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787580091.934175:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac208338572 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d3f4 expref: 61 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580091.934194:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8fae4c7d9800) 00010000:00010000:3.0:1787580091.934199:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787580091.934214:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6200/0xc86deac2083385e2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d417 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787580091.934677:0:5854:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:3.0:1787580091.934912:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7600/0xc86deac2083385e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580091.934938:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7600/0xc86deac2083385e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580091.934948:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7600/0xc86deac2083385e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580091.935006:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6200/0xc86deac2083385e2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d417 expref: 63 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580091.935023:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7600/0xc86deac2083385e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d417 expref: 62 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580091.935032:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8fae530b1e00) 00010000:00010000:3.0:1787580091.935035:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787580091.935038:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae5f6d7600, rc 0) 00000100:00100000:3.0:1787580091.935108:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d4e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+62:11672:x1874413239758848:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 Request processed in 992us (1618us total) trans 4294967504 rc 0/0 00000100:00100000:3.0:1787580091.935118:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 219 00000100:00100000:0.0:1787580091.955040:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580091.955816:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239759104 00000100:00100000:3.0:1787580091.955832:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239759104 00000100:00100000:3.0:1787580091.955954:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 220 00000100:00100000:3.0:1787580091.955969:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5f812d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+62:11672:x1874413239759104:12345-192.168.202.36@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787580091.956041:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787580091.956071:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7600/0xc86deac2083385e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d417 expref: 62 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580091.956090:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8fae530b1e00) 00010000:00010000:3.0:1787580091.956111:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787580091.956133:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6200/0xc86deac2083385f7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580091.956147:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6200/0xc86deac2083385f7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580091.956156:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6200/0xc86deac2083385f7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580091.956171:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6e00/0xc86deac2083385fe lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xef977c50 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580091.956179:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6e00/0xc86deac2083385fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xef977c50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580091.956185:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6e00/0xc86deac2083385fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xef977c50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580091.956260:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6200/0xc86deac2083385f7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580091.956267:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6200/0xc86deac2083385f7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580091.956273:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6200/0xc86deac2083385f7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580091.956279:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae5f6d6200 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:3.0:1787580091.956283:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6200/0xc86deac2083385f7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580091.956291:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6200/0xc86deac2083385f7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580091.956306:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8fae4c7d9800) 00010000:00010000:3.0:1787580091.956320:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787580091.956325:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6200/0xc86deac2083385f7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580091.956331:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6200/0xc86deac2083385f7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580091.956340:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6e00/0xc86deac2083385fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xef977c50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580091.956346:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6e00/0xc86deac2083385fe lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xef977c50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580091.956352:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6e00/0xc86deac2083385fe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xef977c50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580091.956356:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae5f6d6e00 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:3.0:1787580091.956359:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6e00/0xc86deac2083385fe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xef977c50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580091.956364:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6e00/0xc86deac2083385fe lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xef977c50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580091.956370:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xef977c50 (ffff8fae530b1f00) 00010000:00010000:3.0:1787580091.956372:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787580091.956375:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6e00/0xc86deac2083385fe lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xef977c50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580091.956421:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6e00/0xc86deac2083385fe lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xef977c50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580091.956526:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5f812d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+61:11672:x1874413239759104:12345-192.168.202.36@tcp:36:lhsmtool_posix.0 Request processed in 560us (1496us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787580091.956534:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 220 00000100:00100000:0.0:1787580091.963374:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580091.963591:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239759232 00000100:00100000:1.0:1787580091.963612:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239759232 00000100:00100000:1.0:1787580091.963685:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 221 00000100:00100000:1.0:1787580091.963702:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5f813100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+61:11672:x1874413239759232:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787580091.963727:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787580091.963758:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58000/0xc86deac208338605 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d41e expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580091.963813:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58a00/0xc86deac20833860c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580091.963828:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58a00/0xc86deac20833860c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580091.963859:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58a00/0xc86deac20833860c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580091.963972:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58000/0xc86deac208338605 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d41e expref: 63 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580091.963991:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58a00/0xc86deac20833860c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d41e expref: 62 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580091.963999:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8fae5bb2f700) 00010000:00010000:1.0:1787580091.964002:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787580091.964005:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae4ca58a00, rc 0) 00000100:00100000:1.0:1787580091.964057:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5f813100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+62:11672:x1874413239759232:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 Request processed in 363us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580091.964064:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 221 00000100:00100000:0.0:1787580091.967924:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580091.969003:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239759488 00000100:00100000:1.0:1787580091.969016:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239759488 00000100:00100000:0.0:1787580091.969200:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 222 00000100:00100000:0.0:1787580091.969211:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5f811500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+62:11672:x1874413239759488:12345-192.168.202.36@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787580091.969299:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac208338613 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580091.969328:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac208338613 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580091.969341:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac208338613 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787580091.969646:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:0.0:1787580091.969667:0:5854:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 439725282314ns, next at 440725270616ns, rc = 0 00000004:00010000:0.0:1787580091.969757:0:5854:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000054760041 reply state 00000000b7d302a0 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac208338613 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580091.969768:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787580091.969916:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5f811500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+64:11672:x1874413239759488:12345-192.168.202.36@tcp:36:lhsmtool_posix.0 Request processed in 704us (2002us total) trans 4294967505 rc 0/0 00000100:00100000:0.0:1787580091.969926:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 222 00010000:00010000:3.0:1787580091.981292:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac208338613 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580091.981318:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac208338613 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580091.981326:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac208338613 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580091.981332:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae50feb600 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:3.0:1787580091.981337:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac208338613 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580091.981345:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac208338613 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580091.981362:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8fae5bb2f700) 00010000:00010000:3.0:1787580091.981365:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787580091.981371:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac208338613 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580091.981377:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb600/0xc86deac208338613 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580091.984157:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580091.985782:0:8897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239759616 00000100:00100000:2.0:1787580091.985804:0:8897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239759616 00000100:00100000:2.0:1787580091.986055:0:8897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 223 00000100:00100000:2.0:1787580091.986067:0:8897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5f810a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+63:11672:x1874413239759616:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787580091.986092:0:8897:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787580091.986114:0:8897:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8400/0xc86deac20833861a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d425 expref: -99 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580091.986175:0:8897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8400/0xc86deac20833861a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d425 expref: 64 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580091.986191:0:8897:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8400/0xc86deac20833861a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d425 expref: 64 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580091.986209:0:8897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8fae5bb2f700) 00010000:00010000:2.0:1787580091.986225:0:8897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787580091.986229:0:8897:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae48db8400, rc 0) 00000100:00100000:2.0:1787580091.986451:0:8897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5f810a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+64:11672:x1874413239759616:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 Request processed in 385us (2302us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580091.986459:0:8897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 223 00000100:00100000:0.0:1787580091.991127:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580091.998822:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239759744 00000100:00100000:1.0:1787580091.998844:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239759744 00000100:00100000:2.0:1787580092.001646:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 63 00000100:00100000:2.0:1787580092.001672:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d14ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+9:2360:x1874413239759744:12345-192.168.202.36@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1787580092.002070:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787580092.002205:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d14ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+10:2360:x1874413239759744:12345-192.168.202.36@tcp:2:lhsmtool_posix.0 Request processed in 538us (11090us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1787580092.002214:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 63 00000100:00100000:0.0:1787580092.007991:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580092.008336:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239760000 00000100:00100000:2.0:1787580092.008349:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239760000 00000100:00100000:2.0:1787580092.008447:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 60 00000100:00100000:2.0:1787580092.008458:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d14e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+64:11672:x1874413239760000:12345-192.168.202.36@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787580092.009031:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d14e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+65:11672:x1874413239760000:12345-192.168.202.36@tcp:35:lhsmtool_posix.0 Request processed in 572us (1057us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1787580092.009041:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 60 00000100:00100000:0.0:1787580092.022511:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580092.022609:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239760256 00000100:00100000:3.0:1787580092.022620:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239760256 00000100:00100000:3.0:1787580092.022687:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 224 00000100:00100000:3.0:1787580092.022712:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d14dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+65:11672:x1874413239760256:12345-192.168.202.36@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787580092.023006:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d14dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+65:11672:x1874413239760256:12345-192.168.202.36@tcp:57:lhsmtool_posix.0 Request processed in 294us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580092.023014:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 224 00000100:00100000:0.0:1787580092.031268:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580092.031380:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239760384 00000100:00100000:1.0:1787580092.031414:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239760384 00000100:00100000:1.0:1787580092.031475:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 225 00000100:00100000:1.0:1787580092.031486:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d14df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+65:11672:x1874413239760384:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787580092.031512:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787580092.031533:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58000/0xc86deac208338621 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d42c expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580092.031638:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58200/0xc86deac208338628 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580092.031655:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58200/0xc86deac208338628 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580092.031678:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58200/0xc86deac208338628 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787580092.031720:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787580092.031752:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58200/0xc86deac208338628 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580092.031791:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58000/0xc86deac208338621 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d42c expref: 67 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580092.031809:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58200/0xc86deac208338628 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d42c expref: 66 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580092.031818:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8fae5bb2f700) 00010000:00010000:1.0:1787580092.031820:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787580092.031824:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae4ca58200, rc 0) 00000100:00100000:1.0:1787580092.031890:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d14df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+66:11672:x1874413239760384:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 Request processed in 405us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580092.031898:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 225 00000100:00100000:0.0:1787580092.034809:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580092.034999:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239760512 00000100:00100000:3.0:1787580092.035012:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239760512 00000100:00100000:3.0:1787580092.035079:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 64 00000100:00100000:3.0:1787580092.035090:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d14ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+10:2361:x1874413239760512:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787580092.035108:0:6705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787580092.035131:0:6705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080997781/0xc86deac20833862f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d433 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787580092.035159:0:6705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8c4ebb, blocks: 0x1 00010000:00010000:3.0:1787580092.035181:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=439s v=(0 0) 00010000:00010000:3.0:1787580092.035186:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787580092.035198:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080997781/0xc86deac20833862f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d433 expref: 11 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580092.035214:0:6705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000080997781/0xc86deac20833862f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d433 expref: 11 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580092.035228:0:6705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae5f6d6e00, rc 0) 00000100:00100000:3.0:1787580092.035415:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d14ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+11:2361:x1874413239760512:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 Request processed in 326us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580092.035422:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 64 00000100:00100000:0.0:1787580092.042770:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580092.043244:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239760768 00000100:00100000:3.0:1787580092.043254:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239760768 00000100:00100000:3.0:1787580092.043341:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 226 00000100:00100000:3.0:1787580092.043353:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d14e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+66:11672:x1874413239760768:12345-192.168.202.36@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787580092.043496:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d14e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+66:11672:x1874413239760768:12345-192.168.202.36@tcp:57:lhsmtool_posix.0 Request processed in 145us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580092.043503:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 226 00000100:00100000:1.0:1787580092.050762:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580092.052060:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239760896 00000100:00100000:0.0:1787580092.052073:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239760896 00000100:00100000:0.0:1787580092.052134:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 65 00000100:00100000:0.0:1787580092.052143:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7ec35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+11:11672:x1874413239760896:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787580092.052161:0:6708:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787580092.052179:0:6708:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000900bbbb0/0xc86deac208338636 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d43a expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580092.052209:0:6708:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000080997781/0xc86deac20833862f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d433 expref: 12 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580092.052219:0:6708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787580092.052223:0:6708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787580092.052228:0:6708:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000900bbbb0/0xc86deac208338636 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d43a expref: 12 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580092.052260:0:6708:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000080997781/0xc86deac20833862f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d433 expref: 12 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580092.052273:0:6708:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000080997781/0xc86deac20833862f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d433 expref: 12 pid: 6705 timeout: 539 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580092.052297:0:6708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d14c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6708:1874413262814080:192.168.202.36@tcp:104: 00000100:00100000:0.0:1787580092.052433:0:6708:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae50edaf00 going to sleep for 11 seconds 00000100:00100000:1.0:1787580092.057145:0:6708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d14c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6708:1874413262814080:192.168.202.36@tcp:104: 00010000:00010000:1.0:1787580092.057183:0:6708:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000900bbbb0/0xc86deac208338636 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d43a expref: 12 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580092.057224:0:6708:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae50fea000, rc 0) 00000100:00100000:1.0:1787580092.057354:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7ec35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+12:11672:x1874413239760896:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 Request processed in 5209us (6602us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580092.057365:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 65 00000100:00100000:2.0:1787580092.072712:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580092.072885:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239761024 00000100:00100000:3.0:1787580092.072901:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239761024 00010000:00010000:3.0:1787580092.073018:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000080997781/0xc86deac20833862f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d433 expref: 12 pid: 6705 timeout: 539 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580092.073070:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 82 00000100:00100000:3.0:1787580092.073082:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d4e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+12:2360:x1874413239761024:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787580092.073100:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787580092.073123:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000080997781/0xc86deac20833862f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d433 expref: 12 pid: 6705 timeout: 539 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580092.073138:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000080997781/0xc86deac20833862f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d433 expref: 12 pid: 6705 timeout: 539 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580092.073160:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080997781/0xc86deac20833862f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d433 expref: 12 pid: 6705 timeout: 539 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580092.073176:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787580092.073181:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787580092.073203:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000900bbbb0/0xc86deac208338636 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d43a expref: 11 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580092.073212:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000900bbbb0/0xc86deac208338636 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d43a expref: 11 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580092.073253:0:5839:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000900bbbb0/0xc86deac208338636 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d43a expref: 11 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580092.073270:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5ff1d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5839:1874413262814208:192.168.202.36@tcp:105: 00000100:00100000:3.0:1787580092.073364:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae779f3f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787580092.075923:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5ff1d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5839:1874413262814208:192.168.202.36@tcp:105: 00010000:00010000:3.0:1787580092.075959:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787580092.076009:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d4e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+11:2360:x1874413239761024:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 2928us (3310us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580092.076021:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 82 00000100:00100000:1.0:1787580092.079252:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580092.080041:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239761152 00000100:00100000:3.0:1787580092.080055:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239761152 00002000:00100000:3.0:1787580092.080117:0:6712:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff8fae7ec35c00 x1874413239761152/t0(0) o4->31d1df27-21ab-4c76-bd19-e53fa778bd7e@192.168.202.36@tcp:578/0 lens 504/0 e 0 to 0 dl 1787580103 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787580092.080129:0:6712:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8fae7ec35c00 with x1874413239761152 ext(0->12) 00002000:00010000:3.0:1787580092.080135:0:6712:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8fae7ec35c00 00000100:00100000:3.0:1787580092.080178:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 7 00000100:00100000:3.0:1787580092.080190:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7ec35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+11:2360:x1874413239761152:12345-192.168.202.36@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787580092.089247:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7ec35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+13:2360:x1874413239761152:12345-192.168.202.36@tcp:4:lhsmtool_posix.0 Request processed in 9039us (9988us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1787580092.089284:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 7 00002000:00100000:0.0:1787580092.089302:0:6712:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff8fae7ec35c00 x1874413239761152/t4294967320(0) o4->31d1df27-21ab-4c76-bd19-e53fa778bd7e@192.168.202.36@tcp:578/0 lens 504/448 e 0 to 0 dl 1787580103 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787580092.089322:0:6712:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8fae7ec35c00 with x1874413239761152 ext(0->12) 00002000:00010000:0.0:1787580092.089329:0:6712:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8fae7ec35c00 00000100:00100000:2.0:1787580092.094569:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580092.094848:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239761280 00000100:00100000:1.0:1787580092.094861:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239761280 00000100:00100000:2.0:1787580092.094998:0:8897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 227 00000100:00100000:2.0:1787580092.095013:0:8897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d4e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+66:11672:x1874413239761280:12345-192.168.202.36@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1787580092.157026:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967505 is committed 00000004:00080000:2.0:1787580092.157041:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000020:00080000:2.0:1787580092.157068:0:5874:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8fae49ebd780 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:2.0:1787580092.157073:0:5874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8fae6d171700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8fae49ebd0c0 00000020:00080000:2.0:1787580092.157090:0:5874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8fae6d171e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8fae5fdd4400 00000004:00080000:2.0:1787580092.157114:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:2.0:1787580092.157136:0:5874:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8fad43647a80 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:2.0:1787580092.157139:0:5874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8fae6d171000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8fad43647540 00000020:00080000:2.0:1787580092.157142:0:5874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8fae6d171c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8fae7ec61800 00000020:00080000:2.0:1787580092.157152:0:5874:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000001:00080000:2.0:1787580092.157168:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:2.0:1787580092.157182:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:0.0:1787580092.157291:0:5885:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000100:00100000:2.0:1787580092.157300:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d14c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874413262814592:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787580092.157372:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1787580092.157482:0:5885:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1787580092.157495:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d14ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262814336:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787580092.157524:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580092.157555:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787580092.157561:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d4e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262814464:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787580092.157568:0:8897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d4e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+20:11672:x1874413239761280:12345-192.168.202.36@tcp:44:lhsmtool_posix.0 Request processed in 62558us (63011us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580092.157579:0:8897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 227 00000100:00100000:0.0:1787580092.157677:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580092.157718:0:10268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262814592 00000100:00100000:0.0:1787580092.157725:0:10268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262814592 00000100:00100000:0.0:1787580092.157783:0:10268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262814336 00000100:00100000:0.0:1787580092.157787:0:10268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262814336 00000100:00100000:0.0:1787580092.157798:0:10268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262814464 00000100:00100000:0.0:1787580092.157801:0:10268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262814464 00000100:00100000:0.0:1787580092.157818:0:10268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787580092.157826:0:10268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d4e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3314:x1874413262814592:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1787580092.157981:0:10268:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1787580092.157984:0:10268:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1787580092 00002000:00010000:0.0:1787580092.157987:0:10268:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787580092.157989:0:10268:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1787580091 -> 1787580092 00002000:00010000:0.0:1787580092.157992:0:10268:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1787580092.158042:0:10268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d4e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3314:x1874413262814592:12345-0@lo:2:osp-syn-1-0.0 Request processed in 216us (669us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1787580092.158059:0:10268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787580092.158072:0:10268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787580092.158079:0:10268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5f6a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3316:x1874413262814336:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1787580092.158094:0:10268:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:0.0:1787580092.158113:0:10268:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041801157/0xc86deac20833863d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580092.158115:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787580092.158123:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d14d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3316:x1874413262814464:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1787580092.158134:0:10268:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008492248e/0xc86deac2083383ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d399 expref: 12 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1787580092.158135:0:6705:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:0.0:1787580092.158143:0:10268:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1787580092.158148:0:10268:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787580092.158153:0:10268:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000041801157/0xc86deac20833863d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787580092.158155:0:6705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a8c4eba, atime: 0x6a8c4ebb, ctime: 0x6a8c4eba, blocks: 0x1 00010000:00010000:2.0:1787580092.158161:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b84a4386/0xc86deac208338644 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580092.158168:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=439s v=(0 0) 00010000:00010000:2.0:1787580092.158171:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787580092.158176:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b84a4386/0xc86deac208338644 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580092.158182:0:10268:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008492248e/0xc86deac2083383ff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d399 expref: 12 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580092.158190:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b84a4386/0xc86deac208338644 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580092.158196:0:10268:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008492248e/0xc86deac2083383ff lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d399 expref: 12 pid: 6708 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580092.158200:0:6705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b84a4386/0xc86deac208338644 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580092.158207:0:10268:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d14c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10268:1874413262814720:192.168.202.36@tcp:104: 00010000:00010000:2.0:1787580092.158214:0:6705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b84a4386/0xc86deac208338644 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580092.158232:0:6705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787580092.158251:0:10268:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae50eda9c0 going to sleep for 11 seconds 00000100:00080000:0.0:1787580092.158267:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1787580092.158703:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8fae6d14c000/2, rc 0, transno 4294967321 00000100:00100000:1.0:1787580092.158710:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d14c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874413262814592:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787580092.159524:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d14d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3316:x1874413262814464:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1398us (1934us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1787580092.159536:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00010000:2.0:1787580092.159561:0:7642:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787580092.159569:0:7642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b84a4386/0xc86deac208338644 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580092.159579:0:7642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db9000 already unused, calling callback (ffffffffc155a230) 00010000:00010000:2.0:1787580092.159584:0:7642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b84a4386/0xc86deac208338644 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787580092.159765:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8fae6d4e3100/2, rc 0, transno 4294967310 00000100:00100000:0.0:1787580092.159793:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d4e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262814464:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1787580092.159837:0:7642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b84a4386/0xc86deac208338644 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580092.159860:0:7642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b84a4386/0xc86deac208338644 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580092.159868:0:7642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b84a4386/0xc86deac208338644 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580092.159889:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787580092.159897:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787580092.159899:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787580092.161540:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580092.161858:0:10268:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d14c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10268:1874413262814720:192.168.202.36@tcp:104: 00010000:00010000:1.0:1787580092.161886:0:10268:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000041801157/0xc86deac20833863d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580092.161961:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239761408 00000100:00100000:0.0:1787580092.161969:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239761408 00000100:00100000:0.0:1787580092.162025:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 69 00000100:00100000:0.0:1787580092.162035:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d4e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+13:2361:x1874413239761408:12345-192.168.202.36@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1787580092.164099:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580092.164265:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239761536 00000100:00100000:3.0:1787580092.164290:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239761536 00010000:00010000:3.0:1787580092.164336:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008492248e/0xc86deac2083383ff lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d399 expref: 14 pid: 6708 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580092.164380:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 83 00000100:00100000:3.0:1787580092.164425:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7ec35f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+14:2361:x1874413239761536:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787580092.164442:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787580092.164448:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008492248e/0xc86deac2083383ff lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d399 expref: 14 pid: 6708 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580092.164463:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008492248e/0xc86deac2083383ff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d399 expref: 14 pid: 6708 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580092.164488:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008492248e/0xc86deac2083383ff lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d399 expref: 14 pid: 6708 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580092.164506:0:5840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787580092.164511:0:5840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787580092.164517:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000041801157/0xc86deac20833863d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580092.164527:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000041801157/0xc86deac20833863d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580092.164548:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787580092.164605:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7ec35f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+13:2361:x1874413239761536:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 181us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580092.164623:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 83 00010000:00010000:1.0:1787580092.164858:0:10268:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000041801157/0xc86deac20833863d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580092.164869:0:10268:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000041801157/0xc86deac20833863d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580092.164879:0:10268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041801157/0xc86deac20833863d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580092.164895:0:10268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000041801157/0xc86deac20833863d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580092.164918:0:10268:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787580092.165454:0:10268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5f6a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3316:x1874413262814336:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7374us (7928us total) trans 4294967322 rc 0/0 00000100:00100000:1.0:1787580092.165463:0:10268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00010000:0.0:1787580092.166084:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787580092.166091:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000041801157/0xc86deac20833863d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580092.166100:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae50feb800 already unused, calling callback (ffffffffc155a230) 00010000:00010000:0.0:1787580092.166103:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000041801157/0xc86deac20833863d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580092.166110:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000041801157/0xc86deac20833863d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580092.166122:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000041801157/0xc86deac20833863d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580092.166126:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000041801157/0xc86deac20833863d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580092.166140:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787580092.166141:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787580092.166143:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787580092.166448:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8fae6d14ce00/2, rc 0, transno 4294967322 00000100:00100000:3.0:1787580092.166455:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d14ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262814336:0@lo:6:osp-syn-1-0.0 00000001:00080000:1.0:1787580092.234621:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000001:00080000:1.0:1787580092.234641:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000001:00080000:1.0:1787580092.234658:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000001:00080000:1.0:1787580092.234669:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967319 is committed 00000001:00080000:1.0:1787580092.234683:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000100:00100000:2.0:1787580092.235121:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d4e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+7:2361:x1874413239761408:12345-192.168.202.36@tcp:16:lhsmtool_posix.0 Request processed in 73080us (73584us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580092.235133:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 69 00000100:00100000:1.0:1787580092.238308:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580092.238538:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239761792 00000100:00100000:3.0:1787580092.238548:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239761792 00000100:00100000:2.0:1787580092.238908:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 228 00000100:00100000:2.0:1787580092.238985:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7ec35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+20:11672:x1874413239761792:12345-192.168.202.36@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787580092.239040:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787580092.239067:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58200/0xc86deac208338628 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d42c expref: 20 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580092.239086:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8fae5bb2f700) 00010000:00010000:2.0:1787580092.239091:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787580092.239120:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac20833864b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580092.239133:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac20833864b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580092.239142:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac20833864b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787580092.239884:0:5854:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b968d4a3 reply state 00000000e61d947d transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac20833864b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580092.239898:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787580092.240026:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7ec35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+21:11672:x1874413239761792:12345-192.168.202.36@tcp:36:lhsmtool_posix.0 Request processed in 1107us (1726us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1787580092.240055:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 228 00000100:00100000:1.0:1787580092.243202:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580092.243424:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239761920 00000100:00100000:2.0:1787580092.243433:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239761920 00000100:00100000:2.0:1787580092.243478:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 70 00000100:00100000:2.0:1787580092.243488:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7ec36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+7:2360:x1874413239761920:12345-192.168.202.36@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787580092.243752:0:6705:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1787580092.243756:0:6705:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1787580092 -> 1787580091 00002000:00010000:2.0:1787580092.243759:0:6705:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1787580091 00002000:00010000:2.0:1787580092.243761:0:6705:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1787580092 -> 1787580091 00002000:00010000:2.0:1787580092.243764:0:6705:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1787580092.243847:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7ec36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+8:2360:x1874413239761920:12345-192.168.202.36@tcp:2:lhsmtool_posix.0 Request processed in 360us (656us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1787580092.243857:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 70 00000100:00100000:2.0:1787580092.246149:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580092.246222:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239762176 00000100:00100000:1.0:1787580092.246232:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239762176 00000100:00100000:1.0:1787580092.246292:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 229 00000100:00100000:1.0:1787580092.246304:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d4e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+21:11672:x1874413239762176:12345-192.168.202.36@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787580092.246379:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58000/0xc86deac208338652 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580092.246427:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58a00/0xc86deac20833860c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d41e expref: 21 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580092.246437:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58000/0xc86deac208338652 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580092.246493:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58a00/0xc86deac20833860c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d41e expref: 21 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580092.246508:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58a00/0xc86deac20833860c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d41e expref: 21 pid: 5853 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580092.246521:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7ec36300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5853:1874413262814848:192.168.202.36@tcp:104: 00000100:00100000:1.0:1787580092.247200:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae455a8c00 going to sleep for 11 seconds 00010000:00010000:0.0:1787580092.247321:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac20833864b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580092.247348:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac20833864b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580092.247355:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac20833864b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580092.247360:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db9000 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:0.0:1787580092.247365:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac20833864b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580092.247372:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac20833864b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580092.247505:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8fae5bb2f700) 00010000:00010000:0.0:1787580092.247509:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787580092.247513:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac20833864b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580092.247519:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac20833864b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580092.254587:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580092.255062:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7ec36300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5853:1874413262814848:192.168.202.36@tcp:104: 00010000:00010000:1.0:1787580092.255096:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58000/0xc86deac208338652 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580092.255154:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239762304 00000100:00100000:2.0:1787580092.255164:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239762304 00010000:00010000:2.0:1787580092.255205:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58a00/0xc86deac20833860c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d41e expref: 21 pid: 5853 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580092.255281:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 84 00000100:00100000:2.0:1787580092.255292:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5ff1d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+21:2360:x1874413239762304:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787580092.255309:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787580092.255317:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58a00/0xc86deac20833860c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d41e expref: 21 pid: 5853 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580092.255349:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58a00/0xc86deac20833860c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d41e expref: 21 pid: 5853 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580092.255372:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58a00/0xc86deac20833860c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d41e expref: 21 pid: 5853 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580092.255430:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8fae5bb2f700) 00010000:00010000:2.0:1787580092.255436:0:5839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58000/0xc86deac208338652 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580092.255445:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58000/0xc86deac208338652 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580092.255453:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58000/0xc86deac208338652 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580092.255473:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787580092.255534:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5ff1d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+20:2360:x1874413239762304:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 244us (958us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580092.255542:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 84 00010000:00010000:1.0:1787580092.255602:0:5853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58000/0xc86deac208338652 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580092.255610:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58000/0xc86deac208338652 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580092.255639:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58000/0xc86deac208338652 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580092.255647:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58000/0xc86deac208338652 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580092.255653:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58000/0xc86deac208338652 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580092.255659:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae4ca58000 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:1.0:1787580092.255664:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58000/0xc86deac208338652 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580092.255679:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58000/0xc86deac208338652 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580092.255699:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8fae5bb2f700) 00010000:00010000:1.0:1787580092.255702:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787580092.255706:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58000/0xc86deac208338652 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580092.255712:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58000/0xc86deac208338652 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580092.255751:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d4e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+19:11672:x1874413239762176:12345-192.168.202.36@tcp:55:lhsmtool_posix.0 Request processed in 9448us (9609us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787580092.255758:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 229 00000100:00100000:3.0:1787580092.258478:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580092.258612:0:10268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239762432 00000100:00100000:0.0:1787580092.258622:0:10268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239762432 00000100:00100000:0.0:1787580092.258670:0:10268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 71 00000100:00100000:0.0:1787580092.258680:0:10268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5ff1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+8:2361:x1874413239762432:12345-192.168.202.36@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787580092.258735:0:10268:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002c3e8c7a/0xc86deac208338659 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580092.258757:0:10268:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000900bbbb0/0xc86deac208338636 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d43a expref: 8 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580092.258788:0:10268:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1787580092.258792:0:10268:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787580092.258796:0:10268:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c3e8c7a/0xc86deac208338659 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580092.258830:0:10268:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000900bbbb0/0xc86deac208338636 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d43a expref: 8 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580092.258844:0:10268:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000900bbbb0/0xc86deac208338636 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d43a expref: 8 pid: 6708 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580092.258858:0:10268:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d14f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10268:1874413262814976:192.168.202.36@tcp:104: 00000100:00100000:0.0:1787580092.259228:0:10268:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae50eda540 going to sleep for 11 seconds 00000100:00100000:0.0:1787580092.265635:0:10268:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d14f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10268:1874413262814976:192.168.202.36@tcp:104: 00010000:00010000:0.0:1787580092.265665:0:10268:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002c3e8c7a/0xc86deac208338659 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580092.267609:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580092.267948:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239762560 00000100:00100000:0.0:1787580092.267958:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239762560 00010000:00010000:0.0:1787580092.268007:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000900bbbb0/0xc86deac208338636 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d43a expref: 9 pid: 6708 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580092.268093:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 85 00000100:00100000:0.0:1787580092.268104:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d4e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+9:2360:x1874413239762560:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787580092.268132:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787580092.268156:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000900bbbb0/0xc86deac208338636 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d43a expref: 9 pid: 6708 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580092.268171:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000900bbbb0/0xc86deac208338636 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d43a expref: 9 pid: 6708 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580092.268201:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000900bbbb0/0xc86deac208338636 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d43a expref: 9 pid: 6708 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580092.268219:0:5838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787580092.268224:0:5838:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787580092.268231:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002c3e8c7a/0xc86deac208338659 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580092.268242:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c3e8c7a/0xc86deac208338659 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580092.268276:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787580092.268342:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d4e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+8:2360:x1874413239762560:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 239us (749us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580092.268350:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 85 00010000:00010000:1.0:1787580092.268419:0:10268:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002c3e8c7a/0xc86deac208338659 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580092.268430:0:10268:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c3e8c7a/0xc86deac208338659 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580092.268454:0:10268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002c3e8c7a/0xc86deac208338659 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580092.268463:0:10268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c3e8c7a/0xc86deac208338659 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580092.268471:0:10268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c3e8c7a/0xc86deac208338659 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580092.268486:0:10268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae50feae00 already unused, calling callback (ffffffffc155a230) 00010000:00010000:1.0:1787580092.268491:0:10268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c3e8c7a/0xc86deac208338659 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580092.268500:0:10268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c3e8c7a/0xc86deac208338659 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580092.268514:0:10268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c3e8c7a/0xc86deac208338659 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580092.268521:0:10268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c3e8c7a/0xc86deac208338659 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580092.268566:0:10268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5ff1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+7:2361:x1874413239762432:12345-192.168.202.36@tcp:1:lhsmtool_posix.0 Request processed in 9887us (10099us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580092.268573:0:10268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 71 00000100:00100000:1.0:1787580092.271322:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580092.271521:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239762816 00000100:00100000:0.0:1787580092.271533:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239762816 00000100:00100000:1.0:1787580092.271886:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 230 00000100:00100000:1.0:1787580092.271901:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7ec36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+19:11672:x1874413239762816:12345-192.168.202.36@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787580092.271996:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58000/0xc86deac208338660 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580092.272013:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58000/0xc86deac208338660 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580092.272043:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58000/0xc86deac208338660 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580092.272271:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58a00/0xc86deac208338667 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580092.272283:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8400/0xc86deac20833861a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d425 expref: 20 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580092.272291:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58a00/0xc86deac208338667 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580092.272326:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8400/0xc86deac20833861a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d425 expref: 20 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580092.272341:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8400/0xc86deac20833861a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d425 expref: 20 pid: 8897 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580092.272356:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7ec34700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5852:1874413262815104:192.168.202.36@tcp:104: 00000100:00100000:1.0:1787580092.272479:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae455a8c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787580092.274751:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7ec34700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5852:1874413262815104:192.168.202.36@tcp:104: 00010000:00010000:3.0:1787580092.274790:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58a00/0xc86deac208338667 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580092.276016:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580092.276305:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239762944 00000100:00100000:3.0:1787580092.276314:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239762944 00010000:00010000:3.0:1787580092.276355:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8400/0xc86deac20833861a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d425 expref: 21 pid: 8897 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580092.276434:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 86 00000100:00100000:3.0:1787580092.276444:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7ec34e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+21:2360:x1874413239762944:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787580092.276460:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787580092.276468:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8400/0xc86deac20833861a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d425 expref: 21 pid: 8897 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580092.276482:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8400/0xc86deac20833861a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d425 expref: 21 pid: 8897 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580092.276506:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8400/0xc86deac20833861a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d425 expref: 21 pid: 8897 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580092.276540:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8fae5bb2f700) 00010000:00010000:3.0:1787580092.276546:0:5839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58a00/0xc86deac208338667 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580092.276555:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58a00/0xc86deac208338667 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580092.276562:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58a00/0xc86deac208338667 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580092.276586:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787580092.276649:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7ec34e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+20:2360:x1874413239762944:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 206us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580092.276657:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 86 00010000:00010000:3.0:1787580092.276682:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58a00/0xc86deac208338667 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580092.276689:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58a00/0xc86deac208338667 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787580092.277324:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:3.0:1787580092.277581:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:3.0:1787580092.277871:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:3.0:1787580092.278000:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae507b9880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5852:1874413262815232:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787580092.278067:0:5852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580092.278141:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae48cb7900 going to sleep for 11 seconds 00000100:00100000:0.0:1787580092.278949:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262815232 00000100:00100000:0.0:1787580092.278959:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262815232 00000100:00100000:0.0:1787580092.279174:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787580092.279194:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae507b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5852:x1874413262815232:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787580092.279299:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae507b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5852:x1874413262815232:12345-0@lo:1000:mdt00_000.0 Request processed in 106us (1230us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580092.279307:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787580092.279370:0:5852:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:3.0:1787580092.279377:0:5852:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967322 00000004:00080000:3.0:1787580092.279433:0:5852:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8fae6d14c000, transno 4294967321 00000004:00080000:3.0:1787580092.279451:0:5852:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8fae6d14ce00, transno 4294967322 00000100:00100000:3.0:1787580092.279460:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae507b9880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5852:1874413262815232:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1787580092.279991:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:3.0:1787580092.280062:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae507b9880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5852:1874413262815360:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787580092.280106:0:5852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580092.281639:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae49ebda80 going to sleep for 11 seconds 00000100:00100000:2.0:1787580092.281870:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262815360 00000100:00100000:2.0:1787580092.281880:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262815360 00000100:00100000:1.0:1787580092.281992:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787580092.282002:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae507bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5852:x1874413262815360:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787580092.282261:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae507bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5852:x1874413262815360:12345-0@lo:1000:mdt00_000.0 Request processed in 260us (2154us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1787580092.282269:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787580092.282363:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae507b9880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5852:1874413262815360:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1787580092.282436:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58a00/0xc86deac208338667 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580092.282447:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58a00/0xc86deac208338667 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580092.282454:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58a00/0xc86deac208338667 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580092.282460:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae4ca58a00 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:3.0:1787580092.282465:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58a00/0xc86deac208338667 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580092.282472:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58a00/0xc86deac208338667 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580092.282489:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8fae5bb2f700) 00010000:00010000:3.0:1787580092.282493:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787580092.282498:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58a00/0xc86deac208338667 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580092.282505:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58a00/0xc86deac208338667 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580092.282562:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58600/0xc86deac2083385aa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580092.282568:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58600/0xc86deac2083385aa lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580092.282573:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58600/0xc86deac2083385aa lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580092.282577:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae4ca58600 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:3.0:1787580092.282580:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58600/0xc86deac2083385aa lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580092.282585:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58600/0xc86deac2083385aa lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580092.282910:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8fae4c7d9000) 00010000:00010000:3.0:1787580092.282914:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787580092.282921:0:5852:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7400/0xc86deac2083385b1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d409 expref: 23 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580092.282933:0:5852:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7400/0xc86deac2083385b1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d409 expref: 23 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580092.282941:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7400/0xc86deac2083385b1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d409 expref: 23 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580092.283036:0:5852:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7400/0xc86deac2083385b1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d409 expref: 23 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580092.283052:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d4e1180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5852:1874413262815488:192.168.202.36@tcp:105: 00000100:00100000:2.0:1787580092.283145:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae434cc480 going to sleep for 11 seconds 00000100:00100000:1.0:1787580092.286271:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580092.286838:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239763072 00000100:00100000:0.0:1787580092.286849:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239763072 00000100:00100000:0.0:1787580092.286908:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 61 00000100:00100000:0.0:1787580092.286918:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7ec34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+24:11670:x1874413239763072:12345-192.168.202.36@tcp:49:lfs.0 00000100:00100000:0.0:1787580092.287060:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7ec34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+24:11670:x1874413239763072:12345-192.168.202.36@tcp:49:lfs.0 Request processed in 142us (798us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580092.287067:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 61 00000100:00100000:1.0:1787580092.289185:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580092.289272:0:8897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239763328 00000100:00100000:3.0:1787580092.289283:0:8897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239763328 00000100:00100000:3.0:1787580092.289361:0:8897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 231 00000100:00100000:3.0:1787580092.289371:0:8897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7ec35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+24:11670:x1874413239763328:12345-192.168.202.36@tcp:58:lfs.0 00000040:00080000:3.0:1787580092.289828:0:8897:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1787580092.289916:0:8897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7ec35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+24:11670:x1874413239763328:12345-192.168.202.36@tcp:58:lfs.0 Request processed in 546us (740us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580092.289925:0:8897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 231 00000100:00100000:2.0:1787580092.296682:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d4e1180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5852:1874413262815488:192.168.202.36@tcp:105: 00010000:00010000:2.0:1787580092.296736:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58600/0xc86deac2083385aa lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580092.296748:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58600/0xc86deac2083385aa lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580092.296800:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac20833866e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580092.296814:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac20833866e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580092.296823:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac20833866e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580092.296833:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac20833866e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580092.296838:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac20833866e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580092.296844:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac20833866e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580092.296849:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db8200 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:2.0:1787580092.296852:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac20833866e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580092.296859:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac20833866e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580092.296869:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8fae4c7d9000) 00010000:00010000:2.0:1787580092.296887:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787580092.296892:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac20833866e lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580092.296898:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac20833866e lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580092.296907:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58000/0xc86deac208338660 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580092.296912:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58000/0xc86deac208338660 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580092.296917:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58000/0xc86deac208338660 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580092.296921:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae4ca58000 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:2.0:1787580092.296924:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58000/0xc86deac208338660 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580092.296929:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58000/0xc86deac208338660 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580092.296936:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8fae4c7d9000) 00010000:00010000:2.0:1787580092.296938:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787580092.296940:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58000/0xc86deac208338660 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580092.296945:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58000/0xc86deac208338660 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580092.297925:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7ec36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+23:11672:x1874413239762816:12345-192.168.202.36@tcp:57:lhsmtool_posix.0 Request processed in 26021us (26605us total) trans 4294967512 rc 0/0 00000100:00100000:2.0:1787580092.297947:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 230 00000020:00080000:2.0:1787580092.297954:0:5852:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1787580092.299906:0:11700:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787580092.299915:0:11700:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787580092.299968:0:11700:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1787580092.299975:0:11700:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787580092.300108:0:11700:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d14f480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11700:1874413262815616:192.168.202.36@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787580092.300196:0:11700:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae50eda9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787580092.302549:0:11700:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d14f480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11700:1874413262815616:192.168.202.36@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787580092.305442:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580092.305530:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239763456 00000100:00100000:2.0:1787580092.305543:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239763456 00000100:00100000:2.0:1787580092.305615:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 232 00000100:00100000:2.0:1787580092.305626:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7ec34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+23:11674:x1874413239763456:12345-192.168.202.36@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787580092.305663:0:5854:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787580092.305807:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7ec34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+23:11674:x1874413239763456:12345-192.168.202.36@tcp:53:lhsmtool_posix.0 Request processed in 182us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580092.305815:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 232 00000100:00100000:0.0:1787580092.307164:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580092.307669:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239763712 00000100:00100000:2.0:1787580092.307679:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239763712 00000100:00100000:2.0:1787580092.307750:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 62 00000100:00100000:2.0:1787580092.307760:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51881050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+23:11672:x1874413239763712:12345-192.168.202.36@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787580092.308515:0:5856:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787580092.308617:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:2.0:1787580092.308666:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac208338675 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580092.308683:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac208338675 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580092.308695:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac208338675 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580092.308704:0:5856:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac208338675 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580092.308719:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac208338675 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580092.308724:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac208338675 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580092.308747:0:5856:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787580092.308855:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51881050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+25:11672:x1874413239763712:12345-192.168.202.36@tcp:35:lhsmtool_posix.0 Request processed in 1094us (1696us total) trans 4294967514 rc 0/0 00000100:00100000:2.0:1787580092.308863:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 62 00000020:00080000:2.0:1787580092.308868:0:5856:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787580092.309783:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787580092.309793:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac208338675 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580092.309804:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db9e00 already unused, calling callback (ffffffffc155a230) 00010000:00010000:1.0:1787580092.309809:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac208338675 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580092.309818:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac208338675 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580092.309835:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8fae4c7d9e00) 00010000:00010000:1.0:1787580092.309839:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787580092.309844:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac208338675 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580092.309849:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac208338675 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580092.309870:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787580092.309872:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787580092.309874:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787580092.312348:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580092.313945:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239763968 00000100:00100000:0.0:1787580092.313957:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239763968 00000100:00100000:0.0:1787580092.314039:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 233 00000100:00100000:0.0:1787580092.314051:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7ec37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+25:11674:x1874413239763968:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787580092.314076:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787580092.314099:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50febe00/0xc86deac20833867c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d441 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580092.314231:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb200/0xc86deac208338683 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580092.314248:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb200/0xc86deac208338683 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580092.314260:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb200/0xc86deac208338683 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787580092.314272:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1787580092.314441:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50febe00/0xc86deac20833867c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d441 expref: 28 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580092.314460:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb200/0xc86deac208338683 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d441 expref: 27 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580092.314469:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8fae4c7d9000) 00010000:00010000:0.0:1787580092.314472:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787580092.314475:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae50feb200, rc 0) 00000100:00100000:0.0:1787580092.314544:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7ec37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+27:11674:x1874413239763968:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 Request processed in 494us (2203us total) trans 4294967515 rc 0/0 00000100:00100000:0.0:1787580092.314552:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 233 00000100:00100000:0.0:1787580092.342154:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580092.342202:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580092.342417:0:8897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239764224 00000100:00100000:3.0:1787580092.342426:0:8897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239764224 00000100:00100000:3.0:1787580092.342519:0:8897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239764352 00000100:00100000:3.0:1787580092.342523:0:8897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239764352 00000100:00100000:3.0:1787580092.342563:0:8897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 234 00000100:00100000:3.0:1787580092.342574:0:8897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d14d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+28:11674:x1874413239764224:12345-192.168.202.36@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787580092.342685:0:8897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6e00/0xc86deac208338691 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580092.342715:0:8897:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6e00/0xc86deac208338691 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580092.342727:0:8897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6e00/0xc86deac208338691 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580092.342846:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 235 00000100:00100000:1.0:1787580092.342857:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d14fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+28:11675:x1874413239764352:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:1.0:1787580092.342868:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787580092.342880:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58200/0xc86deac208338698 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d448 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580092.342944:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac20833869f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580092.342954:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac20833869f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580092.342961:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac20833869f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580092.342976:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58000/0xc86deac2083386a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580092.342983:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58000/0xc86deac2083386a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580092.342990:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58000/0xc86deac2083386a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580092.343232:0:8897:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6e00/0xc86deac208338691 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580092.343239:0:8897:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6e00/0xc86deac208338691 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580092.343246:0:8897:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6e00/0xc86deac208338691 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580092.343251:0:8897:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae5f6d6e00 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:3.0:1787580092.343261:0:8897:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6e00/0xc86deac208338691 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580092.343269:0:8897:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6e00/0xc86deac208338691 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580092.343280:0:8897:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8fae4c7d9000) 00010000:00010000:1.0:1787580092.343280:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58600/0xc86deac2083386ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580092.343283:0:8897:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787580092.343287:0:8897:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6e00/0xc86deac208338691 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580092.343290:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea800/0xc86deac20833859c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d402 expref: 30 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580092.343294:0:8897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6e00/0xc86deac208338691 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8897 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580092.343298:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58600/0xc86deac2083386ad lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580092.343328:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea800/0xc86deac20833859c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d402 expref: 30 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580092.343353:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea800/0xc86deac20833859c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d402 expref: 30 pid: 5853 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580092.343369:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7ec35500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5852:1874413262815744:192.168.202.36@tcp:104: 00000040:00080000:2.0:1787580092.343563:0:11700:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787580092.343568:0:11700:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:3.0:1787580092.343991:0:8897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d14d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+30:11674:x1874413239764224:12345-192.168.202.36@tcp:57:lhsmtool_posix.0 Request processed in 1415us (1844us total) trans 4294967516 rc 0/0 00000100:00100000:3.0:1787580092.344000:0:8897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 234 00000040:00080000:2.0:1787580092.344517:0:11700:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1787580092.344528:0:11700:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787580092.353089:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae455a8000 going to sleep for 11 seconds 00000100:00100000:1.0:1787580092.359373:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580092.359490:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239764608 00000100:00100000:2.0:1787580092.359501:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239764608 00000100:00100000:2.0:1787580092.359567:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 63 00000100:00100000:2.0:1787580092.359578:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7ec37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+30:10605:x1874413239764608:12345-192.168.202.36@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787580092.359846:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7ec37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+31:10605:x1874413239764608:12345-192.168.202.36@tcp:35:ldlm_bl.0 Request processed in 269us (485us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1787580092.359854:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 63 00000100:00100000:3.0:1787580092.360051:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7ec35500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5852:1874413262815744:192.168.202.36@tcp:104: 00010000:00010000:3.0:1787580092.360077:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58600/0xc86deac2083386ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580092.363327:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580092.363467:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580092.363560:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239764992 00000100:00100000:0.0:1787580092.363571:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239764992 00010000:00010000:0.0:1787580092.363624:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea800/0xc86deac20833859c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d402 expref: 31 pid: 5853 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580092.363699:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 87 00000100:00100000:0.0:1787580092.363710:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48d86850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+31:2360:x1874413239764992:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787580092.363728:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787580092.363736:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea800/0xc86deac20833859c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d402 expref: 31 pid: 5853 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580092.363750:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea800/0xc86deac20833859c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d402 expref: 31 pid: 5853 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580092.363783:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea800/0xc86deac20833859c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d402 expref: 31 pid: 5853 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580092.363800:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8fae4c7d9000) 00010000:00010000:0.0:1787580092.363805:0:5838:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58600/0xc86deac2083386ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580092.363815:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58600/0xc86deac2083386ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580092.363821:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58600/0xc86deac2083386ad lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580092.363855:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787580092.363911:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48d86850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+30:2360:x1874413239764992:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 202us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580092.363918:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 87 00000100:00100000:2.0:1787580092.365069:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239764864 00000100:00100000:2.0:1787580092.365087:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239764864 00000100:00100000:2.0:1787580092.365140:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 64 00000100:00100000:2.0:1787580092.365158:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7ec34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+30:11674:x1874413239764864:12345-192.168.202.36@tcp:35:lhsmtool_posix.0 00010000:00010000:1.0:1787580092.365509:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58600/0xc86deac2083386ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580092.365520:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58600/0xc86deac2083386ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787580092.365554:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1787580092.365558:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787580092.365584:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58600/0xc86deac2083386ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580092.365603:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58600/0xc86deac2083386ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580092.365615:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac20833869f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580092.365622:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac20833869f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580092.365636:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac20833869f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580092.365657:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae4ca59200 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:1.0:1787580092.365661:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac20833869f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580092.365676:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac20833869f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580092.365689:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8fae4c7d9800) 00010000:00010000:1.0:1787580092.366042:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787580092.366049:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac20833869f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580092.366073:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac20833869f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580092.366089:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58000/0xc86deac2083386a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580092.366095:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58000/0xc86deac2083386a6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580092.366101:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58000/0xc86deac2083386a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580092.366106:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae4ca58000 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:1.0:1787580092.366109:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58000/0xc86deac2083386a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580092.366133:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58000/0xc86deac2083386a6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580092.366154:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8fae5bb2f400) 00010000:00010000:1.0:1787580092.366157:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787580092.366160:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58000/0xc86deac2083386a6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580092.366183:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58000/0xc86deac2083386a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580092.366223:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58200/0xc86deac208338698 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d448 expref: 32 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580092.366237:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58600/0xc86deac2083386ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d448 expref: 31 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580092.366245:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8fae4c7d9000) 00010000:00010000:1.0:1787580092.366247:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787580092.366250:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae4ca58600, rc 0) 00000100:00100000:1.0:1787580092.366317:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d14fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+31:11675:x1874413239764352:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 23462us (24114us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580092.366326:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 235 00000100:00100000:3.0:1787580092.376617:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7ec34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+30:11674:x1874413239764864:12345-192.168.202.36@tcp:35:lhsmtool_posix.0 Request processed in 11455us (13288us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1787580092.376633:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 64 00010000:00010000:1.0:1787580092.920740:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787580093.279472:0:12588:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787580093.279482:0:12588:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787580093.279527:0:12588:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1787580093.279535:0:12588:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787580093.555148:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580093.555335:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239765248 00000100:00100000:2.0:1787580093.555362:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239765248 00000100:00080000:0.0:1787580093.555583:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787580093.555679:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 236 00000100:00100000:2.0:1787580093.555691:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7ec37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+30:11698:x1874413239765248:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:2.0:1787580093.555717:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787580093.555740:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8a00/0xc86deac2083386b4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d44f expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580093.555860:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9800/0xc86deac2083386bb lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580093.555875:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9800/0xc86deac2083386bb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580093.555888:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9800/0xc86deac2083386bb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787580093.555899:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1787580093.556026:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8a00/0xc86deac2083386b4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d44f expref: 33 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580093.556046:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9800/0xc86deac2083386bb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d44f expref: 32 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580093.556055:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8fae4c7d9000) 00010000:00010000:2.0:1787580093.556058:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787580093.556062:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae48db9800, rc 0) 00000100:00100000:2.0:1787580093.556146:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7ec37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+32:11698:x1874413239765248:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 458us (1009us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1787580093.556153:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 236 00000100:00100000:3.0:1787580093.559217:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580093.559365:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239765376 00000100:00100000:0.0:1787580093.559699:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239765376 00000100:00100000:0.0:1787580093.559774:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 237 00000100:00100000:0.0:1787580093.559784:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae507b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+32:11698:x1874413239765376:12345-192.168.202.36@tcp:54:lfs.0 00010000:00010000:0.0:1787580093.559855:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea000/0xc86deac2083386c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580093.559872:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea000/0xc86deac2083386c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580093.559884:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea000/0xc86deac2083386c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580093.559910:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea000/0xc86deac2083386c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580093.559917:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea000/0xc86deac2083386c9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580093.559924:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea000/0xc86deac2083386c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580093.559930:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae50fea000 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:0.0:1787580093.559935:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea000/0xc86deac2083386c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580093.559942:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea000/0xc86deac2083386c9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580093.559953:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8fae4c7d9000) 00010000:00010000:0.0:1787580093.559956:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787580093.559961:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea000/0xc86deac2083386c9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580093.559974:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea000/0xc86deac2083386c9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580093.560047:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae507b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+32:11698:x1874413239765376:12345-192.168.202.36@tcp:54:lfs.0 Request processed in 264us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580093.560054:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 237 00000001:00080000:2.0:1787580093.597029:0:6733:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:2.0:1787580093.597069:0:6733:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:2.0:1787580093.597083:0:6733:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:0.0:1787580093.680981:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580093.682231:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239765504 00000100:00100000:2.0:1787580093.682247:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239765504 00000100:00100000:2.0:1787580093.682329:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 72 00000100:00100000:2.0:1787580093.682341:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d14ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+7:2360:x1874413239765504:12345-192.168.202.36@tcp:101:cat.0 00010000:00010000:2.0:1787580093.682362:0:6705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787580093.687637:0:6705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080997781/0xc86deac2083386d0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d456 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787580093.687903:0:6705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a8c4ebb, atime: 0x6a8c4ebb, ctime: 0x6a8c4ebb, blocks: 0xb 00010000:00010000:3.0:1787580093.687926:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=441s v=(0 0) 00010000:00010000:3.0:1787580093.687931:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787580093.687942:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080997781/0xc86deac2083386d0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d456 expref: 8 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580093.687960:0:6705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000080997781/0xc86deac2083386d0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d456 expref: 8 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580093.687972:0:6705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae5f6d6e00, rc 0) 00000100:00100000:3.0:1787580093.688078:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d14ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+8:2360:x1874413239765504:12345-192.168.202.36@tcp:101:cat.0 Request processed in 5739us (7107us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580093.688085:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 72 00000100:00100000:0.0:1787580093.695139:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580093.695743:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239765632 00000100:00100000:3.0:1787580093.695768:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239765632 00002000:00100000:3.0:1787580093.695829:0:6713:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff8fae6d14f800 x1874413239765632/t0(0) o3->31d1df27-21ab-4c76-bd19-e53fa778bd7e@192.168.202.36@tcp:579/0 lens 488/0 e 0 to 0 dl 1787580104 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787580093.695842:0:6713:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8fae6d14f800 with x1874413239765632 ext(0->4095) 00002000:00010000:3.0:1787580093.695849:0:6713:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8fae6d14f800 00000100:00100000:3.0:1787580093.695925:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 8 00000100:00100000:3.0:1787580093.695937:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d14f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+8:2361:x1874413239765632:12345-192.168.202.36@tcp:3:cat.0 00000100:00100000:3.0:1787580093.696187:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d14f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+8:2361:x1874413239765632:12345-192.168.202.36@tcp:3:cat.0 Request processed in 251us (1058us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787580093.696204:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 8 00002000:00100000:3.0:1787580093.696212:0:6713:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff8fae6d14f800 x1874413239765632/t0(0) o3->31d1df27-21ab-4c76-bd19-e53fa778bd7e@192.168.202.36@tcp:579/0 lens 488/4536 e 0 to 0 dl 1787580104 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787580093.696221:0:6713:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8fae6d14f800 with x1874413239765632 ext(0->4095) 00002000:00010000:3.0:1787580093.696224:0:6713:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8fae6d14f800 00010000:00010000:2.0:1787580093.940315:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787580094.585930:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae507bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874413262815872:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787580094.586004:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580094.586081:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262815872 00000100:00100000:3.0:1787580094.586090:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262815872 00000100:00100000:3.0:1787580094.586151:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787580094.586161:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae507b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874413262815872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787580094.586201:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787580094.586245:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae507b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874413262815872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580094.586252:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:3.0:1787580094.586274:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787580094.586302:0:3315:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:3.0:1787580094.586307:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8fae5f6fdc00, transno 4294967307 00000004:00080000:3.0:1787580094.586318:0:3315:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:3.0:1787580094.586336:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8fae6d4e3100, transno 4294967310 00000100:00100000:3.0:1787580094.586348:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae507bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874413262815872:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787580094.964792:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787580095.094445:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d14e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874413262816256:0@lo:400:kworker.0 00000100:00100000:0.0:1787580095.094517:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580095.094708:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d14f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3316:1874413262816000:0@lo:400:kworker.0 00000100:00100000:3.0:1787580095.094765:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580095.094792:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d14c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262816512:0@lo:400:kworker.0 00000100:00100000:3.0:1787580095.094835:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580095.094858:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787580095.094864:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d14d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874413262816128:0@lo:400:kworker.0 00000100:00100000:3.0:1787580095.094887:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580095.094912:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d14f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1874413262816384:0@lo:400:kworker.0 00000100:00100000:3.0:1787580095.094935:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580095.094969:0:8897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262816256 00000100:00100000:3.0:1787580095.094977:0:8897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262816256 00000100:00100000:3.0:1787580095.095028:0:8897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262816128 00000100:00100000:3.0:1787580095.095032:0:8897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262816128 00000100:00100000:3.0:1787580095.095044:0:8897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262816384 00000100:00100000:3.0:1787580095.095047:0:8897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262816384 00000100:00100000:3.0:1787580095.095065:0:8897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1787580095.095074:0:8897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d14ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874413262816256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787580095.095123:0:8897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d14ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874413262816256:12345-0@lo:400:kworker.0 Request processed in 50us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580095.095131:0:8897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1787580095.095148:0:8897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1787580095.095154:0:8897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae507bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874413262816128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787580095.095185:0:8897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae507bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874413262816128:12345-0@lo:400:kworker.0 Request processed in 31us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580095.095191:0:8897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1787580095.095203:0:8897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1787580095.095209:0:8897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae507bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874413262816384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787580095.095238:0:8897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae507bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874413262816384:12345-0@lo:400:kworker.0 Request processed in 30us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580095.095255:0:8897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1787580095.095276:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262816000 00000100:00100000:3.0:1787580095.095279:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262816000 00000100:00100000:3.0:1787580095.095300:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1787580095.095305:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:3316:x1874413262816000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787580095.095334:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:3316:x1874413262816000:12345-0@lo:400:kworker.0 Request processed in 29us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580095.095340:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00080000:3.0:1787580095.095362:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787580095.095420:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d14f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1874413262816384:0@lo:400:kworker.0 00000100:00100000:3.0:1787580095.095449:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d14d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874413262816128:0@lo:400:kworker.0 00000100:00100000:3.0:1787580095.095457:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d14f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3316:1874413262816000:0@lo:400:kworker.0 00000100:00100000:2.0:1787580095.095709:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262816512 00000100:00100000:2.0:1787580095.095713:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262816512 00000100:00100000:2.0:1787580095.095774:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787580095.095782:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae507bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3316:x1874413262816512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787580095.095823:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae507bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3316:x1874413262816512:12345-0@lo:400:kworker.0 Request processed in 43us (987us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580095.095829:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787580095.095862:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d14c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262816512:0@lo:400:kworker.0 00000100:00100000:0.0:1787580095.096011:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d14e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874413262816256:0@lo:400:kworker.0 00000100:00080000:3.0:1787580095.096061:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787580095.605894:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787580095.605916:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d4e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262816640:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787580095.605991:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580095.606116:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262816640 00000100:00100000:3.0:1787580095.606125:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262816640 00000100:00100000:3.0:1787580095.606177:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787580095.606187:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d4e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1874413262816640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787580095.606221:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787580095.606266:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d4e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1874413262816640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580095.606273:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787580095.606315:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d4e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262816640:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787580095.951523:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580095.951583:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580095.951623:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580095.951651:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580095.951695:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580095.951775:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239765760 00000100:00100000:2.0:1787580095.951791:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239765760 00000100:00100000:3.0:1787580095.951856:0:8897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239765888 00000100:00100000:2.0:1787580095.951862:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 305 00000100:00100000:3.0:1787580095.951863:0:8897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239765888 00000100:00100000:2.0:1787580095.951876:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ff68ada-0c43-4367-93b7-ad31684360cf+13:2361:x1874413239765760:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:3.0:1787580095.951923:0:8897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239766272 00000100:00100000:3.0:1787580095.951929:0:8897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239766272 00000100:00100000:3.0:1787580095.951956:0:8897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 172 00000100:00100000:2.0:1787580095.951962:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ff68ada-0c43-4367-93b7-ad31684360cf+13:2361:x1874413239765760:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 89us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580095.951969:0:8897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7ec37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+32:2361:x1874413239765888:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:2.0:1787580095.951976:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 305 00000100:00100000:3.0:1787580095.952014:0:8897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7ec37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:31d1df27-21ab-4c76-bd19-e53fa778bd7e+32:2361:x1874413239765888:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 48us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580095.952024:0:8897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 172 00000100:00100000:3.0:1787580095.952039:0:8897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 173 00000100:00100000:3.0:1787580095.952046:0:8897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7ec35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8d66e8ae-0b45-4a46-9f01-8e93d52be8ea+5:2361:x1874413239766272:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:3.0:1787580095.952070:0:8897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7ec35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8d66e8ae-0b45-4a46-9f01-8e93d52be8ea+5:2361:x1874413239766272:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 25us (375us total) trans 0 rc 0/0 00000100:00080000:2.0:1787580095.952796:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787580095.953443:0:8897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 173 00000100:00100000:0.0:1787580095.959508:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239766144 00000100:00100000:0.0:1787580095.959528:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239766144 00000100:00080000:2.0:1787580095.959831:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787580095.960830:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239766016 00000100:00100000:0.0:1787580095.960841:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239766016 00000100:00080000:2.0:1787580095.960932:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787580095.961048:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 85 00000100:00100000:1.0:1787580095.961064:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7ec35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+8:2361:x1874413239766144:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:1.0:1787580095.961290:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7ec35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+8:2361:x1874413239766144:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 230us (9705us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580095.961298:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 85 00000100:00100000:1.0:1787580095.961316:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 86 00000100:00100000:1.0:1787580095.961323:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7ec34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+5:2361:x1874413239766016:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:1.0:1787580095.961350:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7ec34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+5:2361:x1874413239766016:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 28us (9698us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580095.961355:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 86 00010000:00010000:1.0:1787580095.991473:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787580096.435769:0:11700:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787580096.435780:0:11700:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787580096.435829:0:11700:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1787580096.435837:0:11700:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787580097.015442:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787580097.237775:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967515 is committed 00000020:00080000:2.0:1787580097.237790:0:5874:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:2.0:1787580097.237810:0:5885:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000020:00080000:2.0:1787580097.237821:0:5885:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000001:00080000:2.0:1787580097.237845:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:2.0:1787580097.237888:0:5874:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8fae48cb7600 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:2.0:1787580097.237892:0:5874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8fae48ddc800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8fae48cb7900 00000020:00080000:2.0:1787580097.237895:0:5874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8fae48ddc300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8fae5faf9400 00000020:00080000:2.0:1787580097.237911:0:5885:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:2.0:1787580097.238115:0:5885:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000001:00080000:1.0:1787580097.703982:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:1.0:1787580097.703997:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00010000:00010000:2.0:1787580098.037287:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787580099.060548:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787580099.613114:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580099.613259:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239766400 00000100:00100000:2.0:1787580099.613275:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239766400 00000100:00100000:2.0:1787580099.613415:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 238 00000100:00100000:2.0:1787580099.613431:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d14e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+19:11359:x1874413239766400:12345-192.168.202.36@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1787580099.613561:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d14e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:31d1df27-21ab-4c76-bd19-e53fa778bd7e+19:11359:x1874413239766400:12345-192.168.202.36@tcp:60:lhsmtool_posix.0 Request processed in 133us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580099.613570:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 238 00000100:00080000:3.0:1787580099.613770:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787580099.622166:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580099.622310:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239766656 00000100:00100000:3.0:1787580099.622321:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239766656 00000100:00100000:3.0:1787580099.622376:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 65 00000100:00100000:3.0:1787580099.622417:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d4e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+19:11359:x1874413239766656:12345-192.168.202.36@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787580099.623758:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d4e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+20:11359:x1874413239766656:12345-192.168.202.36@tcp:35:lhsmtool_posix.0 Request processed in 1209us (1444us total) trans 4294967520 rc 0/0 00000100:00100000:0.0:1787580099.623771:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 65 00000100:00100000:3.0:1787580099.702635:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787580099.702665:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d4e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874413262816768:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787580099.702773:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580099.703721:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262816768 00000100:00100000:0.0:1787580099.703732:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262816768 00000100:00100000:0.0:1787580099.703810:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787580099.703821:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae507b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874413262816768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787580099.703859:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787580099.703944:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae507b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874413262816768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 124us (1171us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580099.703952:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787580099.703990:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d4e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874413262816768:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787580099.704733:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787580100.039792:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580100.040886:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239766784 00000100:00100000:2.0:1787580100.040902:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239766784 00000100:00100000:2.0:1787580100.041014:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 239 00000100:00100000:2.0:1787580100.041029:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7ec34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8d66e8ae-0b45-4a46-9f01-8e93d52be8ea+5:12150:x1874413239766784:12345-192.168.202.36@tcp:101:lsof.0 00010000:00010000:2.0:1787580100.041090:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787580100.041114:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac2083386d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d45d expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580100.041181:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac2083386de lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580100.041196:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac2083386de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580100.041209:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac2083386de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787580100.041698:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787580100.041720:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1787580100.041814:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac2083386de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580100.041842:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac2083386d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d45d expref: 7 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580100.041859:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac2083386de lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d45d expref: 6 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580100.041867:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fae4c7d9c00) 00010000:00010000:2.0:1787580100.041870:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787580100.041874:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae48db8800, rc 0) 00000100:00100000:2.0:1787580100.041958:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7ec34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8d66e8ae-0b45-4a46-9f01-8e93d52be8ea+6:12150:x1874413239766784:12345-192.168.202.36@tcp:101:lsof.0 Request processed in 933us (2179us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580100.041966:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 239 00000100:00080000:3.0:1787580100.042063:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787580100.083618:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787580100.212027:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d4e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1874413262817152:0@lo:400:kworker.0 00000100:00100000:3.0:1787580100.212028:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d4e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874413262817024:0@lo:400:kworker.0 00000100:00100000:1.0:1787580100.212124:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d4e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3315:1874413262816896:0@lo:400:kworker.0 00000100:00100000:0.0:1787580100.212175:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7f35f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874413262817280:0@lo:400:kworker.0 00000100:00100000:2.0:1787580100.214097:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787580100.214221:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262817152 00000100:00100000:2.0:1787580100.214233:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262817152 00000100:00100000:2.0:1787580100.214325:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1787580100.214340:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae77a88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874413262817152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787580100.214542:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae77a88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874413262817152:12345-0@lo:400:kworker.0 Request processed in 205us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580100.214551:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00080000:2.0:1787580100.214580:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787580100.214614:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d4e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1874413262817152:0@lo:400:kworker.0 00000100:00100000:3.0:1787580100.221562:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787580100.221976:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262817024 00000100:00100000:2.0:1787580100.221987:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262817024 00000100:00100000:2.0:1787580100.222063:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1787580100.222074:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae507bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874413262817024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787580100.222152:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae507bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874413262817024:12345-0@lo:400:kworker.0 Request processed in 81us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580100.222159:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1787580100.222458:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d4e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874413262817024:0@lo:400:kworker.0 00000100:00100000:1.0:1787580100.228478:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787580100.228558:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7f35fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874413262817408:0@lo:400:kworker.0 00000100:00100000:1.0:1787580100.228611:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580100.229017:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262816896 00000100:00100000:3.0:1787580100.229028:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262816896 00000100:00100000:3.0:1787580100.229085:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1787580100.229096:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:3315:x1874413262816896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787580100.229164:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:3315:x1874413262816896:12345-0@lo:400:kworker.0 Request processed in 70us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580100.229171:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1787580100.229274:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262817408 00000100:00100000:2.0:1787580100.229280:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262817408 00000100:00100000:2.0:1787580100.229349:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787580100.229356:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7ec34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1874413262817408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787580100.229413:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7ec34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1874413262817408:12345-0@lo:400:kworker.0 Request processed in 58us (802us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580100.229420:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:3.0:1787580100.229559:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787580100.233565:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d4e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3315:1874413262816896:0@lo:400:kworker.0 00000100:00100000:1.0:1787580100.233603:0:3315:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:1.0:1787580100.233610:0:3315:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:1.0:1787580100.233634:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7f35fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874413262817408:0@lo:400:kworker.0 00000100:00100000:0.0:1787580100.241974:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787580100.242692:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262817280 00000100:00100000:2.0:1787580100.242712:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262817280 00000100:00100000:2.0:1787580100.242819:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1787580100.242831:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d14ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874413262817280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787580100.242925:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d14ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874413262817280:12345-0@lo:400:kworker.0 Request processed in 98us (963us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580100.242934:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00080000:3.0:1787580100.246587:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787580100.248739:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7f35f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874413262817280:0@lo:400:kworker.0 00000100:00100000:3.0:1787580100.723685:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d4e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262817536:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787580100.723791:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580100.723928:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262817536 00000100:00100000:0.0:1787580100.723939:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262817536 00000100:00100000:0.0:1787580100.724002:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787580100.724013:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae507ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262817536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787580100.724050:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787580100.732216:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae507ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262817536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 8191us (8412us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580100.732233:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787580100.733137:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d4e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262817536:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787580101.070326:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580101.070371:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580101.070445:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580101.070498:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580101.070526:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580101.070556:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239767168 00000100:00100000:0.0:1787580101.070556:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239767424 00000100:00100000:1.0:1787580101.070569:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239767168 00000100:00100000:0.0:1787580101.070569:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239767424 00000100:00100000:0.0:1787580101.070635:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239767040 00000100:00100000:0.0:1787580101.070639:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239767040 00000100:00100000:0.0:1787580101.070671:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 177 00000100:00100000:0.0:1787580101.070687:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7f35fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8d66e8ae-0b45-4a46-9f01-8e93d52be8ea+6:2359:x1874413239767424:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:0.0:1787580101.070796:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7f35fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8d66e8ae-0b45-4a46-9f01-8e93d52be8ea+6:2359:x1874413239767424:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 115us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580101.070803:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 177 00000100:00100000:0.0:1787580101.070821:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 178 00000100:00100000:0.0:1787580101.070827:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7efc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+20:2359:x1874413239767040:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:0.0:1787580101.070860:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7efc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+20:2359:x1874413239767040:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 33us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580101.070886:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 178 00000100:00100000:1.0:1787580101.070975:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239767296 00000100:00100000:1.0:1787580101.070980:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239767296 00000100:00100000:1.0:1787580101.071002:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 88 00000100:00100000:1.0:1787580101.071011:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7f35f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+5:2359:x1874413239767168:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:1.0:1787580101.071041:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7f35f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+5:2359:x1874413239767168:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 31us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580101.071048:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 88 00000100:00100000:1.0:1787580101.071062:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 89 00000100:00100000:1.0:1787580101.071068:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7efc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+7:2359:x1874413239767296:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:1.0:1787580101.071109:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7efc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+7:2359:x1874413239767296:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 39us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580101.071116:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 89 00000100:00100000:2.0:1787580101.071623:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239766912 00000100:00100000:2.0:1787580101.071629:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239766912 00000100:00100000:2.0:1787580101.071673:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 307 00000100:00100000:2.0:1787580101.071681:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ff68ada-0c43-4367-93b7-ad31684360cf+13:2359:x1874413239766912:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:2.0:1787580101.071734:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ff68ada-0c43-4367-93b7-ad31684360cf+13:2359:x1874413239766912:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 54us (1420us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580101.071740:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 307 00000100:00080000:3.0:1787580101.071973:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787580101.071980:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787580101.071982:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787580101.109147:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787580102.141836:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787580102.293537:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:0.0:1787580102.293554:0:5874:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:2.0:1787580102.293620:0:5885:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1787580102.293630:0:5885:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:0.0:1787580103.156591:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787580104.185226:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787580104.643839:0:12793:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 10:01:42 (1787580102) 00000100:00100000:0.0:1787580104.820919:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787580104.820945:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d4e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262817664:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787580104.821024:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787580104.821146:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262817664 00000100:00100000:2.0:1787580104.821156:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262817664 00000100:00100000:2.0:1787580104.821235:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787580104.821246:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d14ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262817664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787580104.821288:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787580104.821341:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d14ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262817664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580104.821349:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:0.0:1787580104.822296:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787580104.822365:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d4e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262817664:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787580105.204266:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787580105.331969:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787580105.337517:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d4e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874413262817920:0@lo:400:kworker.0 00000100:00100000:3.0:1787580105.337763:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580105.337818:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d4e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3315:1874413262817792:0@lo:400:kworker.0 00000100:00100000:3.0:1787580105.337844:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787580105.337988:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d4e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874413262818048:0@lo:400:kworker.0 00000100:00100000:2.0:1787580105.338013:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787580105.338046:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787580105.338052:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fad43124000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262818176:0@lo:400:kworker.0 00000100:00100000:2.0:1787580105.338074:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580105.338140:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262817920 00000100:00100000:0.0:1787580105.338148:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262817920 00000100:00100000:0.0:1787580105.338185:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262818048 00000100:00100000:0.0:1787580105.338187:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262818048 00000100:00100000:0.0:1787580105.338211:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1787580105.338219:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae507b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874413262817920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787580105.338274:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae507b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874413262817920:12345-0@lo:400:kworker.0 Request processed in 56us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580105.338281:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1787580105.338295:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1787580105.338301:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d5b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874413262818048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787580105.338322:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d5b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874413262818048:12345-0@lo:400:kworker.0 Request processed in 22us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580105.338328:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00080000:0.0:1787580105.338348:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787580105.338913:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262818176 00000100:00100000:1.0:1787580105.338919:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262818176 00000100:00100000:1.0:1787580105.338949:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787580105.338955:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d5b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262818176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787580105.338991:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d5b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262818176:12345-0@lo:400:kworker.0 Request processed in 36us (916us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580105.339003:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787580105.339023:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fad43127b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874413262818304:0@lo:400:kworker.0 00000100:00100000:1.0:1787580105.339047:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787580105.339066:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787580105.339071:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d5b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874413262818432:0@lo:400:kworker.0 00000100:00100000:1.0:1787580105.339088:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787580105.339105:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262818304 00000100:00100000:1.0:1787580105.339108:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262818304 00000100:00100000:1.0:1787580105.339128:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1787580105.339134:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7efcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874413262818304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787580105.339159:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7efcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874413262818304:12345-0@lo:400:kworker.0 Request processed in 25us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580105.339164:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1787580105.339177:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262818432 00000100:00100000:1.0:1787580105.339179:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262818432 00000100:00100000:1.0:1787580105.339199:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787580105.339204:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae50728e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874413262818432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787580105.339228:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae50728e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874413262818432:12345-0@lo:400:kworker.0 Request processed in 23us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580105.339233:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:1.0:1787580105.339243:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787580105.339245:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787580105.339270:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d5b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874413262818432:0@lo:400:kworker.0 00000100:00100000:1.0:1787580105.339279:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fad43127b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874413262818304:0@lo:400:kworker.0 00000100:00100000:1.0:1787580105.339330:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262817792 00000100:00100000:1.0:1787580105.339339:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262817792 00000100:00100000:1.0:1787580105.339360:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1787580105.339365:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae487de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:3315:x1874413262817792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787580105.339408:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae487de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:3315:x1874413262817792:12345-0@lo:400:kworker.0 Request processed in 43us (1563us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580105.339414:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1787580105.339944:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d4e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874413262817920:0@lo:400:kworker.0 00000100:00100000:3.0:1787580105.339953:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d4e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3315:1874413262817792:0@lo:400:kworker.0 00000100:00100000:2.0:1787580105.340205:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fad43124000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262818176:0@lo:400:kworker.0 00000100:00100000:2.0:1787580105.340217:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d4e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874413262818048:0@lo:400:kworker.0 00000100:00100000:1.0:1787580105.847635:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787580105.847671:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d5b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874413262818560:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787580105.847756:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787580105.847924:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262818560 00000100:00100000:2.0:1787580105.847932:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262818560 00000100:00100000:2.0:1787580105.847992:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787580105.848003:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5072b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874413262818560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787580105.848043:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787580105.848091:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5072b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874413262818560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580105.848098:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787580105.848141:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d5b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874413262818560:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787580106.188457:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580106.188823:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239767552 00000100:00100000:3.0:1787580106.188834:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239767552 00000100:00100000:3.0:1787580106.188880:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 309 00000100:00100000:3.0:1787580106.188889:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae487df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ff68ada-0c43-4367-93b7-ad31684360cf+13:2358:x1874413239767552:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:3.0:1787580106.188949:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae487df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ff68ada-0c43-4367-93b7-ad31684360cf+13:2358:x1874413239767552:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 61us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580106.188956:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 309 00000100:00100000:0.0:1787580106.189002:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580106.189852:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239767680 00000100:00100000:3.0:1787580106.189858:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239767680 00000100:00100000:3.0:1787580106.189959:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 182 00000100:00100000:3.0:1787580106.189967:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d14c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+19:2358:x1874413239767680:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:3.0:1787580106.190009:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d14c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+19:2358:x1874413239767680:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 43us (1508us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580106.190016:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 182 00000100:00080000:0.0:1787580106.190407:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787580106.194059:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580106.194149:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239767808 00000100:00100000:1.0:1787580106.194163:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239767808 00000100:00100000:1.0:1787580106.194245:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 92 00000100:00100000:1.0:1787580106.194257:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d14c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+5:2358:x1874413239767808:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:1.0:1787580106.194339:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d14c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+5:2358:x1874413239767808:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 84us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580106.194347:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 92 00000100:00080000:0.0:1787580106.194879:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787580106.196587:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580106.196627:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580106.196831:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239767936 00000100:00100000:1.0:1787580106.196840:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239767936 00000100:00100000:1.0:1787580106.196900:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 93 00000100:00100000:1.0:1787580106.196911:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d14c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+7:2359:x1874413239767936:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:1.0:1787580106.196984:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d14c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+7:2359:x1874413239767936:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 75us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580106.196992:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 93 00000100:00100000:2.0:1787580106.197125:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239768064 00000100:00100000:2.0:1787580106.197130:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239768064 00000100:00100000:2.0:1787580106.197165:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 183 00000100:00100000:2.0:1787580106.197174:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d14f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d66e8ae-0b45-4a46-9f01-8e93d52be8ea+6:2359:x1874413239768064:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:2.0:1787580106.197208:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d14f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d66e8ae-0b45-4a46-9f01-8e93d52be8ea+6:2359:x1874413239768064:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 36us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580106.197214:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 183 00000100:00080000:0.0:1787580106.197310:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787580106.197315:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787580106.231586:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787580106.676960:0:11700:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787580106.676969:0:11700:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787580106.677487:0:11700:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1787580106.677495:0:11700:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787580107.251801:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787580108.275739:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787580108.885185:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580108.886705:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239768320 00000100:00100000:0.0:1787580108.886725:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239768320 00000100:00100000:0.0:1787580108.886873:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 66 00000100:00100000:0.0:1787580108.886891:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae507b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+19:12371:x1874413239768320:12345-192.168.202.36@tcp:35:umount.0 00000100:00100000:0.0:1787580108.894668:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae507b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+20:12371:x1874413239768320:12345-192.168.202.36@tcp:35:umount.0 Request processed in 7750us (9466us total) trans 4294967521 rc 0/0 00000100:00100000:0.0:1787580108.894695:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 66 00000100:00080000:1.0:1787580108.900014:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787580108.903690:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580108.903887:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239768576 00000100:00100000:3.0:1787580108.903898:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239768576 00000100:00100000:3.0:1787580108.903989:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 67 00000100:00100000:3.0:1787580108.904009:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d14d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+20:12371:x1874413239768576:12345-192.168.202.36@tcp:35:umount.0 00000100:00100000:3.0:1787580108.904413:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d14d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+21:12371:x1874413239768576:12345-192.168.202.36@tcp:35:umount.0 Request processed in 371us (702us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1787580108.904420:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 67 00000100:00100000:2.0:1787580108.911854:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580108.911948:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239768832 00000100:00100000:0.0:1787580108.911960:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239768832 00000100:00100000:0.0:1787580108.912022:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 68 00000100:00100000:0.0:1787580108.912033:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51881c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+21:12371:x1874413239768832:12345-192.168.202.36@tcp:35:umount.0 00000100:00100000:0.0:1787580108.912736:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51881c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+22:12371:x1874413239768832:12345-192.168.202.36@tcp:35:umount.0 Request processed in 702us (890us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1787580108.912757:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 68 00000100:00100000:1.0:1787580108.915229:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580108.915305:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239769088 00000100:00100000:0.0:1787580108.915315:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239769088 00000100:00100000:0.0:1787580108.915420:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 69 00000100:00100000:0.0:1787580108.915430:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5072b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+22:12371:x1874413239769088:12345-192.168.202.36@tcp:35:umount.0 00000100:00100000:0.0:1787580108.916189:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5072b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+23:12371:x1874413239769088:12345-192.168.202.36@tcp:35:umount.0 Request processed in 758us (970us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1787580108.916196:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 69 00000100:00100000:1.0:1787580108.925666:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580108.925713:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580108.925907:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239769344 00000100:00100000:2.0:1787580108.925918:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239769344 00000100:00100000:2.0:1787580108.925979:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239769216 00000100:00100000:2.0:1787580108.925982:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239769216 00000100:00100000:2.0:1787580108.926029:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 17 00000100:00100000:2.0:1787580108.926038:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae50728000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ff68ada-0c43-4367-93b7-ad31684360cf+14:2358:x1874413239769344:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787580108.926055:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787580108.926080:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fae41660400/0xc86deac2083376bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9cfb0 expref: 14 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580108.926100:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787580108.926153:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae50728000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ff68ada-0c43-4367-93b7-ad31684360cf+13:2358:x1874413239769344:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 116us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580108.926161:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 17 00000100:00100000:2.0:1787580108.926178:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 18 00000100:00100000:2.0:1787580108.926185:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae50729500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ff68ada-0c43-4367-93b7-ad31684360cf+12:2358:x1874413239769216:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787580108.926192:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787580108.926201:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fae4150e400/0xc86deac208337756 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9cfe8 expref: 12 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580108.926211:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787580108.926227:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae50729500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ff68ada-0c43-4367-93b7-ad31684360cf+11:2358:x1874413239769216:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 43us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580108.926233:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 18 00000100:00100000:2.0:1787580108.928278:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580108.928981:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239769472 00000100:00100000:0.0:1787580108.928992:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239769472 00000100:00100000:0.0:1787580108.929072:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 19 00000100:00100000:0.0:1787580108.929082:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d5b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ff68ada-0c43-4367-93b7-ad31684360cf+11:2361:x1874413239769472:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787580108.929101:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787580108.929121:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fae4150ec00/0xc86deac20833796a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d0b3 expref: 11 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580108.929138:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787580108.929203:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d5b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ff68ada-0c43-4367-93b7-ad31684360cf+10:2361:x1874413239769472:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 122us (935us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580108.929210:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 19 00000100:00100000:2.0:1787580108.929970:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580108.930082:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239769856 00000100:00100000:3.0:1787580108.930087:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239769856 00000100:00100000:3.0:1787580108.930145:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 73 00000100:00100000:3.0:1787580108.930153:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d5bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+7:2357:x1874413239769856:12345-192.168.202.36@tcp:9:umount.0 00000020:00000080:3.0:1787580108.930195:0:6705:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc86deac208337c96 00000020:00010000:3.0:1787580108.930202:0:6705:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8fad41109800: total 0 00000100:00080000:3.0:1787580108.930206:0:6705:0:(import.c:65:import_set_state_nolock()) ffff8fad4110e000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787580108.930245:0:6705:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:3.0:1787580108.930738:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d5bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:31d1df27-21ab-4c76-bd19-e53fa778bd7e+5:2357:x1874413239769856:12345-192.168.202.36@tcp:9:umount.0 Request processed in 584us (769us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580108.930747:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 73 00000020:00010000:3.0:1787580108.930770:0:7643:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8fad41109800: total 0 00010000:00010000:3.0:1787580108.930791:0:7643:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8fad41109800, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1787580108.930840:0:7643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003957c304/0xc86deac208338032 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d288 expref: 4 pid: 6707 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580108.930871:0:7643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080997781/0xc86deac2083386d0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d456 expref: 3 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580108.930885:0:7643:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8fad41109800, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1787580108.930896:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787580108.930898:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787580108.930900:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787580108.932022:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787580108.937161:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580108.937297:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239769984 00000100:00100000:1.0:1787580108.937307:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239769984 00000100:00100000:1.0:1787580108.937369:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 74 00000100:00100000:1.0:1787580108.937399:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d5b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+5:2357:x1874413239769984:12345-192.168.202.36@tcp:9:umount.0 00000020:00000080:1.0:1787580108.937433:0:6707:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc86deac208337a2e 00000100:00080000:1.0:1787580108.937440:0:6707:0:(import.c:65:import_set_state_nolock()) ffff8fae6d4a0000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787580108.937479:0:6707:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00080000:0.0:1787580108.938786:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787580108.939523:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d5b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+2:2357:x1874413239769984:12345-192.168.202.36@tcp:9:umount.0 Request processed in 2141us (2367us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580108.939533:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 74 00010000:00010000:2.0:1787580108.939786:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787580108.948695:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580108.948935:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239771008 00000100:00100000:1.0:1787580108.948946:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239771008 00000100:00100000:1.0:1787580108.949007:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 240 00000100:00100000:1.0:1787580108.949017:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae507baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+23:2357:x1874413239771008:12345-192.168.202.36@tcp:39:umount.0 00000020:00000080:1.0:1787580108.949051:0:5853:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc86deac2083376ca 00000020:00010000:1.0:1787580108.949069:0:5853:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8fad4110d000: total 0 00000100:00080000:1.0:1787580108.949074:0:5853:0:(import.c:65:import_set_state_nolock()) ffff8fae6d1e7800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787580108.949106:0:5853:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000020:00010000:0.0:1787580108.949131:0:5842:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8fad4110d000: total 0 00010000:00010000:0.0:1787580108.949174:0:5842:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8fad4110d000, canceled 0 locks, left on hash table 14. 00010000:00010000:0.0:1787580108.949205:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8fae5bb2f900) 00010000:00010000:0.0:1787580108.949208:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787580108.949250:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d6c00/0xc86deac208337cf1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d1af expref: 22 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580108.949271:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8fae56e35700) 00010000:00010000:0.0:1787580108.949273:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787580108.949277:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50febc00/0xc86deac208337994 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d0c1 expref: 21 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580108.949296:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8fae4c7d9800) 00010000:00010000:0.0:1787580108.949298:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787580108.949301:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7c00/0xc86deac20833838f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d37d expref: 21 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580108.949313:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8fae5bb2f900) 00010000:00010000:0.0:1787580108.949315:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787580108.949318:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58800/0xc86deac208337a04 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d0dd expref: 20 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580108.949333:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8fae4c7d9000) 00010000:00010000:0.0:1787580108.949335:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787580108.949339:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae5f6d7400/0xc86deac2083385b1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d409 expref: 19 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580108.949351:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8fae4c7d9000) 00010000:00010000:0.0:1787580108.949353:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787580108.949357:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58600/0xc86deac2083386ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d448 expref: 18 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580108.949368:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8fae4c7d9800) 00010000:00010000:0.0:1787580108.949375:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787580108.949855:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8600/0xc86deac2083380b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d2ab expref: 18 pid: 8897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580108.949872:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae507baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:31d1df27-21ab-4c76-bd19-e53fa778bd7e+15:2357:x1874413239771008:12345-192.168.202.36@tcp:39:umount.0 Request processed in 855us (1186us total) trans 4294967525 rc 0/0 00000100:00100000:1.0:1787580108.949880:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 240 00010000:00010000:2.0:1787580108.952866:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8fae56e35f00) 00010000:00010000:2.0:1787580108.952876:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787580108.952888:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8000/0xc86deac208337f13 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d23b expref: 14 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580108.952928:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8fae5bb2f000) 00010000:00010000:2.0:1787580108.952931:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787580108.952935:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59600/0xc86deac2083379b0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d0c8 expref: 13 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580108.952955:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fae4c7d9c00) 00010000:00010000:2.0:1787580108.952958:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787580108.952961:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9a00/0xc86deac208338094 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d2a4 expref: 12 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580108.952973:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8fae4c7d9000) 00010000:00010000:2.0:1787580108.952975:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787580108.952978:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9800/0xc86deac2083386bb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d44f expref: 11 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580108.952989:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8fae56e35f00) 00010000:00010000:2.0:1787580108.952991:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787580108.953006:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660600/0xc86deac208337ff3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d273 expref: 10 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580108.953020:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8fae56e35f00) 00010000:00010000:2.0:1787580108.953022:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787580108.953026:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae41660a00/0xc86deac20833801d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d281 expref: 9 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580108.953040:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8fae4c7d9000) 00010000:00010000:2.0:1787580108.953042:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787580108.953052:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50feb200/0xc86deac208338683 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d441 expref: 8 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580108.953066:0:5842:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8fad4110d000, canceled 14 locks, left on hash table 0. 00010000:00010000:2.0:1787580108.953100:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787580108.953102:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787580108.953105:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787580109.301975:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787580109.939848:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d5baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874413262818688:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787580109.940022:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787580109.940157:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262818688 00000100:00100000:2.0:1787580109.940166:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262818688 00000100:00100000:2.0:1787580109.940234:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787580109.940245:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fad43124000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874413262818688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787580109.940280:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787580109.940326:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fad43124000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874413262818688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580109.940333:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:0.0:1787580109.942474:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787580109.942625:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d5baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874413262818688:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787580110.323782:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787580110.451664:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae507b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874413262819200:0@lo:400:kworker.0 00000100:00100000:3.0:1787580110.451737:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580110.451808:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787580110.451814:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae507b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1874413262819072:0@lo:400:kworker.0 00000100:00100000:3.0:1787580110.451838:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580110.451865:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262819200 00000100:00100000:3.0:1787580110.451883:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262819200 00000100:00100000:3.0:1787580110.451927:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787580110.451935:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d4e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1874413262819200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787580110.451978:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d4e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1874413262819200:12345-0@lo:400:kworker.0 Request processed in 43us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580110.451984:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787580110.452019:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae507b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874413262819200:0@lo:400:kworker.0 00000100:00100000:2.0:1787580110.452152:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262819072 00000100:00100000:2.0:1787580110.452157:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262819072 00000100:00100000:2.0:1787580110.452206:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1787580110.452213:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d4e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874413262819072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787580110.452257:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d4e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1874413262819072:12345-0@lo:400:kworker.0 Request processed in 45us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580110.452264:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1787580110.452452:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae507ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3314:1874413262818816:0@lo:400:kworker.0 00000100:00100000:1.0:1787580110.452484:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787580110.452521:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae507b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874413262819328:0@lo:400:kworker.0 00000100:00100000:1.0:1787580110.452547:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787580110.452562:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787580110.452566:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae507b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874413262818944:0@lo:400:kworker.0 00000100:00100000:1.0:1787580110.452583:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787580110.452596:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae507b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874413262819456:0@lo:400:kworker.0 00000100:00100000:1.0:1787580110.452628:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787580110.452660:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262819328 00000100:00100000:1.0:1787580110.452663:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262819328 00000100:00100000:1.0:1787580110.452684:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262818944 00000100:00100000:1.0:1787580110.452686:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262818944 00000100:00100000:1.0:1787580110.452698:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1787580110.452703:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fad43127b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874413262819328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787580110.452733:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fad43127b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874413262819328:12345-0@lo:400:kworker.0 Request processed in 29us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580110.452738:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1787580110.452749:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1787580110.452754:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48c91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874413262818944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787580110.452776:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48c91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874413262818944:12345-0@lo:400:kworker.0 Request processed in 22us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580110.452781:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1787580110.452803:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae507b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874413262818944:0@lo:400:kworker.0 00000100:00100000:1.0:1787580110.452822:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae507b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874413262819328:0@lo:400:kworker.0 00000100:00100000:2.0:1787580110.452928:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262818816 00000100:00100000:2.0:1787580110.452932:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262818816 00000100:00100000:2.0:1787580110.452961:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1787580110.452967:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae487dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:3314:x1874413262818816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787580110.452999:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae487dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:3314:x1874413262818816:12345-0@lo:400:kworker.0 Request processed in 31us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580110.453013:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1787580110.453045:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae507ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3314:1874413262818816:0@lo:400:kworker.0 00000100:00100000:3.0:1787580110.453193:0:10268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262819456 00000100:00100000:3.0:1787580110.453197:0:10268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262819456 00000100:00100000:3.0:1787580110.453237:0:10268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787580110.453244:0:10268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5f4adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1874413262819456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787580110.453284:0:10268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5f4adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1874413262819456:12345-0@lo:400:kworker.0 Request processed in 42us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580110.453290:0:10268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:3.0:1787580110.453307:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787580110.453311:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787580110.453328:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae507b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3317:1874413262819072:0@lo:400:kworker.0 00000100:00100000:0.0:1787580110.453440:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae507b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874413262819456:0@lo:400:kworker.0 00000100:00100000:3.0:1787580110.963636:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d5baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262819584:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787580110.963715:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787580110.963839:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262819584 00000100:00100000:2.0:1787580110.963847:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262819584 00000100:00100000:2.0:1787580110.963898:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787580110.963904:0:6709:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:2.0:1787580110.963908:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d4e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262819584:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787580110.963913:0:6709:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:2.0:1787580110.963950:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787580110.964007:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d4e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262819584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580110.964014:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787580110.964108:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d5baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262819584:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787580111.301821:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580111.301876:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580111.302043:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239771264 00000100:00100000:0.0:1787580111.302054:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239771264 00000100:00100000:0.0:1787580111.302141:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 187 00000100:00100000:0.0:1787580111.302154:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d4e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d66e8ae-0b45-4a46-9f01-8e93d52be8ea+6:2359:x1874413239771264:12345-192.168.202.36@tcp:400:kworker.0 00000100:00080000:3.0:1787580111.302304:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787580111.302360:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d4e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8d66e8ae-0b45-4a46-9f01-8e93d52be8ea+6:2359:x1874413239771264:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 209us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580111.302369:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 187 00000100:00100000:1.0:1787580111.303711:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239771136 00000100:00100000:1.0:1787580111.303722:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239771136 00000100:00100000:1.0:1787580111.303785:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 311 00000100:00100000:1.0:1787580111.303794:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae487ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ff68ada-0c43-4367-93b7-ad31684360cf+10:2359:x1874413239771136:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:1.0:1787580111.303861:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae487ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ff68ada-0c43-4367-93b7-ad31684360cf+10:2359:x1874413239771136:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 68us (2050us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580111.303869:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 311 00010000:00010000:2.0:1787580111.347733:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787580111.435786:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580111.435833:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580111.435879:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580111.436081:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239771392 00000100:00100000:0.0:1787580111.436092:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239771392 00000100:00100000:0.0:1787580111.436145:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239771648 00000100:00100000:0.0:1787580111.436148:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239771648 00000100:00100000:0.0:1787580111.436161:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239771520 00000100:00100000:0.0:1787580111.436163:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239771520 00000100:00100000:0.0:1787580111.436179:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 20 00000100:00100000:0.0:1787580111.436189:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae507b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ff68ada-0c43-4367-93b7-ad31684360cf+12:2359:x1874413239771392:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787580111.436206:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787580111.436226:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fae74ed9800/0xc86deac20833779c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9cffd expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580111.436244:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787580111.436329:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae507b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ff68ada-0c43-4367-93b7-ad31684360cf+11:2359:x1874413239771392:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 140us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580111.436337:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 20 00000100:00100000:0.0:1787580111.436354:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 21 00000100:00100000:0.0:1787580111.436361:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae507b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ff68ada-0c43-4367-93b7-ad31684360cf+10:2359:x1874413239771648:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787580111.436368:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787580111.436377:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fae4ca59e00/0xc86deac208337939 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d0ac expref: 10 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580111.436442:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787580111.436464:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae507b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ff68ada-0c43-4367-93b7-ad31684360cf+9:2359:x1874413239771648:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 103us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580111.436470:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 21 00000100:00100000:0.0:1787580111.436483:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 22 00000100:00100000:0.0:1787580111.436488:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae507ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ff68ada-0c43-4367-93b7-ad31684360cf+8:2359:x1874413239771520:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787580111.436496:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787580111.436505:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fae50feb400/0xc86deac2083377a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d027 expref: 8 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580111.436512:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787580111.436540:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae507ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ff68ada-0c43-4367-93b7-ad31684360cf+7:2359:x1874413239771520:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 51us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580111.436546:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 22 00000100:00100000:3.0:1787580111.452514:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580111.453051:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239771904 00000100:00100000:2.0:1787580111.453062:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239771904 00000100:00100000:2.0:1787580111.453127:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 241 00000100:00100000:2.0:1787580111.453138:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae507b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d66e8ae-0b45-4a46-9f01-8e93d52be8ea+6:2357:x1874413239771904:12345-192.168.202.36@tcp:39:umount.0 00000020:00000080:2.0:1787580111.453186:0:5854:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc86deac2083377b1 00000020:00010000:2.0:1787580111.453197:0:5854:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8fae5ff3c800: total 0 00000100:00080000:2.0:1787580111.453201:0:5854:0:(import.c:65:import_set_state_nolock()) ffff8fae5ff39800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787580111.453238:0:5854:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000020:00010000:1.0:1787580111.453676:0:5842:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8fae5ff3c800: total 0 00010000:00010000:1.0:1787580111.453722:0:5842:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8fae5ff3c800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1787580111.453768:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fae4c7d9c00) 00010000:00010000:1.0:1787580111.453772:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787580111.453781:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac2083386de lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d45d expref: 5 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580111.453806:0:5842:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8fae5ff3c800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1787580111.453815:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787580111.453817:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787580111.453818:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787580111.454109:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae507b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8d66e8ae-0b45-4a46-9f01-8e93d52be8ea+3:2357:x1874413239771904:12345-192.168.202.36@tcp:39:umount.0 Request processed in 971us (1608us total) trans 4294967526 rc 0/0 00000100:00100000:2.0:1787580111.454121:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 241 00000100:00100000:3.0:1787580111.493035:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580111.493161:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239772160 00000100:00100000:1.0:1787580111.493171:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239772160 00000100:00100000:1.0:1787580111.493233:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 312 00000100:00100000:1.0:1787580111.493246:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae487df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ff68ada-0c43-4367-93b7-ad31684360cf+7:2357:x1874413239772160:12345-192.168.202.36@tcp:251:umount.0 00000020:00000080:1.0:1787580111.493305:0:5848:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc86deac2083376a7 00000020:00010000:1.0:1787580111.493314:0:5848:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8fae5ff3a000: total 0 00000100:00080000:1.0:1787580111.493326:0:5848:0:(import.c:65:import_set_state_nolock()) ffff8fae5ff38000 : changing import state from FULL to CLOSED 00000020:00010000:2.0:1787580111.493636:0:5841:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8fae5ff3a000: total 0 00010000:00010000:2.0:1787580111.493640:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787580111.493686:0:5841:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8fae5ff3a000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1787580111.493719:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fae4150f000/0xc86deac20833775d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9cfef expref: 3 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580111.493744:0:5841:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8fae5ff3a000, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1787580111.493756:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787580111.493758:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787580111.493760:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787580111.495872:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae487df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ff68ada-0c43-4367-93b7-ad31684360cf+1:2357:x1874413239772160:12345-192.168.202.36@tcp:251:umount.0 Request processed in 2616us (2835us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580111.495889:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 312 00000020:00000080:1.0:1787580111.495906:0:5848:0:(genops.c:885:class_export_put()) final put ffff8fae5ff3a000/7ff68ada-0c43-4367-93b7-ad31684360cf 00000020:00000080:3.0:1787580111.496098:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8fae5ff3a000/7ff68ada-0c43-4367-93b7-ad31684360cf for MGS 00000020:00000080:3.0:1787580111.496134:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8fae5ff38000 for MGS 00010000:00010000:2.0:1787580112.372216:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787580112.594876:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967524 is committed 00000001:00100000:0.0:1787580112.594910:0:5874:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 31d1df27-21ab-4c76-bd19-e53fa778bd7e 00000001:00080000:0.0:1787580112.594917:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000001:00100000:0.0:1787580112.595668:0:5874:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 8d66e8ae-0b45-4a46-9f01-8e93d52be8ea 00000001:00080000:0.0:1787580112.595679:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:0.0:1787580112.595683:0:5874:0:(genops.c:885:class_export_put()) final put ffff8fae5ff3c800/8d66e8ae-0b45-4a46-9f01-8e93d52be8ea 00000020:00000080:0.0:1787580112.595705:0:5874:0:(genops.c:885:class_export_put()) final put ffff8fad4110d000/31d1df27-21ab-4c76-bd19-e53fa778bd7e 00000020:00000080:1.0:1787580112.595873:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8fae5ff3c800/8d66e8ae-0b45-4a46-9f01-8e93d52be8ea for lustre-MDT0000 00000020:00000080:1.0:1787580112.595967:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8fad4110d000/31d1df27-21ab-4c76-bd19-e53fa778bd7e for lustre-MDT0000 00000020:00000080:1.0:1787580112.595993:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8fae5ff39800 for lustre-MDT0000 00000020:00000080:1.0:1787580112.595997:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8fae6d1e7800 for lustre-MDT0000 00000001:00100000:3.0:1787580113.091599:0:7653:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 31d1df27-21ab-4c76-bd19-e53fa778bd7e 00000020:00000080:3.0:1787580113.091611:0:7653:0:(genops.c:885:class_export_put()) final put ffff8fad41109800/31d1df27-21ab-4c76-bd19-e53fa778bd7e 00000020:00000080:0.0:1787580113.091801:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8fad41109800/31d1df27-21ab-4c76-bd19-e53fa778bd7e for lustre-OST0001 00000020:00000080:0.0:1787580113.091848:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8fad4110e000 for lustre-OST0001 00010000:00010000:2.0:1787580113.406116:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787580113.643497:0:12995:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1787580113.680055:0:12995:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1787580113.680112:0:12995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae4150fa00/0xc86deac20833772c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208337733 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580113.680126:0:12995:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae4150fa00/0xc86deac20833772c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc86deac208337733 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580113.680134:0:12995:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae4150fa00/0xc86deac20833772c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xc86deac208337733 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580113.680141:0:12995:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.136@tcp lock: ffff8fae4150fa00/0xc86deac20833772c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xc86deac208337733 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580113.680202:0:12995:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787580113.680208:0:12995:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1787580113.680230:0:12995:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787580113.680235:0:12995:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787580113.680241:0:12995:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787580113.680266:0:12995:0:(import.c:65:import_set_state_nolock()) ffff8fae5068a000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1787580113.680436:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d5b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874413262819712:0@lo:39:umount.0 00000100:00100000:3.0:1787580113.680519:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580113.680914:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262819712 00000100:00100000:0.0:1787580113.680923:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262819712 00000100:00100000:0.0:1787580113.680988:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1787580113.680999:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae507b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874413262819712:12345-0@lo:39:umount.0 00000020:00000080:0.0:1787580113.681031:0:5853:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc86deac2083374b6 00000100:00080000:0.0:1787580113.681040:0:5853:0:(import.c:65:import_set_state_nolock()) ffff8fae50610800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1787580113.681173:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787580113.681181:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.136@tcp lock: ffff8fae4150fa00/0xc86deac20833772c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xc86deac208337733 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580113.681190:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae4150fa00 already unused, calling callback (ffffffffc1b77c20) 10000000:00010000:1.0:1787580113.681194:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.136@tcp lock: ffff8fae4150fa00/0xc86deac20833772c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xc86deac208337733 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580113.681203:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: ffff8fae4150fa00/0xc86deac20833772c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xc86deac208337733 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787580113.681210:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: ffff8fae4150fa00/0xc86deac20833772c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xc86deac208337733 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787580113.681217:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787580113.681219:0:5842:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1787580113.681222:0:5842:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1787580113.681254:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.136@tcp lock: ffff8fae4150fa00/0xc86deac20833772c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xc86deac208337733 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580113.681260:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787580113.681304:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.136@tcp lock: ffff8fae4150fa00/0xc86deac20833772c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xc86deac208337733 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580113.681311:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: ffff8fae4150fa00/0xc86deac20833772c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xc86deac208337733 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580113.681324:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787580113.681326:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787580113.681328:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787580113.681363:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787580113.681375:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7e97f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3316:1874413262819840:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787580113.681465:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787580113.681777:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262819840 00000100:00100000:1.0:1787580113.681783:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262819840 00000100:00100000:1.0:1787580113.681826:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787580113.681833:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48d87850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+19:3316:x1874413262819840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787580113.681844:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787580113.681860:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fae74ed8400/0xc86deac208337733 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc86deac20833772c expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580113.681874:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787580113.681917:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48d87850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+18:3316:x1874413262819840:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580113.681925:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787580113.682084:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7e97f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3316:1874413262819840:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787580113.682292:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae507b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3313:x1874413262819712:12345-0@lo:39:umount.0 Request processed in 1293us (1771us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580113.682300:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:0.0:1787580113.682308:0:5853:0:(genops.c:885:class_export_put()) final put ffff8fae50610000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:3.0:1787580113.682429:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8fae5068a000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1787580113.682442:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d5b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874413262819712:0@lo:39:umount.0 00000020:00000080:1.0:1787580113.682769:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8fae50610000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1787580113.682824:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8fae50610800 for lustre-MDT0000 00010000:00010000:2.0:1787580113.684378:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787580113.684631:0:12995:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787580113.684636:0:12995:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787580113.684643:0:12995:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1787580113.687627:0:12995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae50fea600/0xc86deac20833773a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208337741 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580113.687651:0:12995:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae50fea600/0xc86deac20833773a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc86deac208337741 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580113.687658:0:12995:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae50fea600/0xc86deac20833773a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xc86deac208337741 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580113.687666:0:12995:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.136@tcp lock: ffff8fae50fea600/0xc86deac20833773a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xc86deac208337741 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580113.687688:0:12995:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787580113.687694:0:12995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae4150f200/0xc86deac208337661 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208337668 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580113.687699:0:12995:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae4150f200/0xc86deac208337661 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc86deac208337668 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580113.687714:0:12995:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae4150f200/0xc86deac208337661 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc86deac208337668 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580113.687721:0:12995:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.136@tcp lock: ffff8fae4150f200/0xc86deac208337661 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc86deac208337668 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580113.687760:0:12995:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787580113.687768:0:12995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae48db8c00/0xc86deac20833795c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208337963 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580113.687775:0:12995:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae48db8c00/0xc86deac20833795c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc86deac208337963 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580113.687781:0:12995:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae48db8c00/0xc86deac20833795c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc86deac208337963 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580113.687787:0:12995:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.136@tcp lock: ffff8fae48db8c00/0xc86deac20833795c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc86deac208337963 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580113.687800:0:12995:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1787580113.687805:0:12995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae40030a00/0xc86deac208337415 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac20833741c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580113.687811:0:12995:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae40030a00/0xc86deac208337415 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc86deac20833741c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580113.687817:0:12995:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae40030a00/0xc86deac208337415 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc86deac20833741c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580113.687823:0:12995:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.136@tcp lock: ffff8fae40030a00/0xc86deac208337415 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc86deac20833741c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580113.687838:0:12995:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:2.0:1787580113.687842:0:12995:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:2.0:1787580113.687883:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1787580113.687889:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.136@tcp lock: ffff8fae50fea600/0xc86deac20833773a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xc86deac208337741 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580113.687897:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae50fea600 already unused, calling callback (ffffffffc1b77c20) 10000000:00010000:2.0:1787580113.687901:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.136@tcp lock: ffff8fae50fea600/0xc86deac20833773a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xc86deac208337741 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580113.687909:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: ffff8fae50fea600/0xc86deac20833773a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xc86deac208337741 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787580113.687916:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: ffff8fae50fea600/0xc86deac20833773a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xc86deac208337741 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787580113.687922:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787580113.687924:0:5841:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:2.0:1787580113.687926:0:5841:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:1.0:1787580113.688037:0:7642:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787580113.688043:0:7642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.136@tcp lock: ffff8fae4150f200/0xc86deac208337661 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc86deac208337668 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580113.688050:0:7642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae4150f200 already unused, calling callback (ffffffffc1b77c20) 10000000:00010000:1.0:1787580113.688060:0:7642:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.136@tcp lock: ffff8fae4150f200/0xc86deac208337661 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc86deac208337668 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580113.688067:0:7642:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: ffff8fae4150f200/0xc86deac208337661 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xc86deac208337668 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787580113.688074:0:7642:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: ffff8fae4150f200/0xc86deac208337661 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xc86deac208337668 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787580113.688078:0:7642:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1787580113.688081:0:7642:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1787580113.688082:0:7642:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1787580113.688112:0:7642:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.136@tcp lock: ffff8fae4150f200/0xc86deac208337661 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc86deac208337668 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580113.688119:0:7642:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787580113.688151:0:7642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.136@tcp lock: ffff8fae4150f200/0xc86deac208337661 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc86deac208337668 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580113.688157:0:7642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: ffff8fae4150f200/0xc86deac208337661 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc86deac208337668 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580113.688178:0:7642:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787580113.688181:0:7642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.136@tcp lock: ffff8fae48db8c00/0xc86deac20833795c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc86deac208337963 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580113.688187:0:7642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db8c00 already unused, calling callback (ffffffffc1b77c20) 10000000:00010000:1.0:1787580113.688189:0:7642:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.136@tcp lock: ffff8fae48db8c00/0xc86deac20833795c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc86deac208337963 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580113.688195:0:7642:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: ffff8fae48db8c00/0xc86deac20833795c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc86deac208337963 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787580113.688207:0:7642:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: ffff8fae48db8c00/0xc86deac20833795c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc86deac208337963 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787580113.688213:0:7642:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787580113.688215:0:7642:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1787580113.688216:0:7642:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1787580113.688230:0:7642:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.136@tcp lock: ffff8fae48db8c00/0xc86deac20833795c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xc86deac208337963 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580113.688237:0:7642:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787580113.688244:0:7642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.136@tcp lock: ffff8fae48db8c00/0xc86deac20833795c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xc86deac208337963 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580113.688250:0:7642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: ffff8fae48db8c00/0xc86deac20833795c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xc86deac208337963 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580113.688260:0:7642:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787580113.688263:0:7642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.136@tcp lock: ffff8fae40030a00/0xc86deac208337415 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc86deac20833741c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580113.688269:0:7642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae40030a00 already unused, calling callback (ffffffffc1b77c20) 10000000:00010000:1.0:1787580113.688271:0:7642:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.136@tcp lock: ffff8fae40030a00/0xc86deac208337415 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc86deac20833741c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580113.688277:0:7642:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: ffff8fae40030a00/0xc86deac208337415 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xc86deac20833741c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787580113.688282:0:7642:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: ffff8fae40030a00/0xc86deac208337415 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xc86deac20833741c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787580113.688297:0:7642:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1787580113.688299:0:7642:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1787580113.688300:0:7642:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1787580113.688314:0:7642:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.136@tcp lock: ffff8fae40030a00/0xc86deac208337415 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc86deac20833741c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580113.688320:0:7642:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787580113.688336:0:7642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.136@tcp lock: ffff8fae40030a00/0xc86deac208337415 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc86deac20833741c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580113.688342:0:7642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: ffff8fae40030a00/0xc86deac208337415 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc86deac20833741c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580113.688354:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787580113.688356:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787580113.688358:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787580113.688376:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae50728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3316:1874413262820224:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787580113.688473:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787580113.688555:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262820224 00000100:00100000:1.0:1787580113.688563:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262820224 00000100:00100000:1.0:1787580113.688624:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787580113.688634:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae50729500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+18:3316:x1874413262820224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787580113.688647:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787580113.688660:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fae41661400/0xc86deac20833741c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc86deac208337415 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580113.688674:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787580113.688707:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae50729500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+17:3316:x1874413262820224:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580113.688719:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1787580113.688741:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787580113.688764:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae50728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3316:1874413262820224:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787580113.689127:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.136@tcp lock: ffff8fae50fea600/0xc86deac20833773a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xc86deac208337741 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580113.689134:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787580113.689152:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.136@tcp lock: ffff8fae50fea600/0xc86deac20833773a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xc86deac208337741 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580113.689159:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: ffff8fae50fea600/0xc86deac20833773a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xc86deac208337741 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580113.689169:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787580113.689171:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787580113.689173:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787580113.689189:0:12995:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1787580113.689193:0:12995:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1787580113.689204:0:12995:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787580113.689210:0:12995:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1787580113.689214:0:12995:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8fae5068d800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787580113.689220:0:12995:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8fae77932000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787580113.689225:0:12995:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff8fae50310000) has exports, disconnecting them 00000020:00080000:2.0:1787580113.689229:0:12995:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8fae5068d800), last request at 1787580110 00000020:00000080:2.0:1787580113.689236:0:12995:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc86deac208337629 00000100:00080000:2.0:1787580113.689254:0:12995:0:(import.c:65:import_set_state_nolock()) ffff8fae5068a800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787580113.689298:0:12995:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8fae5068d800): rc 0 00000020:00000080:2.0:1787580113.689301:0:12995:0:(genops.c:885:class_export_put()) final put ffff8fae5068d800/lustre-MDT0000-lwp-OST0001_UUID 00010000:00010000:1.0:1787580113.689338:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787580113.689344:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787580113.689353:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d5b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3316:1874413262820352:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787580113.689379:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580113.689863:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7e97f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3314:1874413262819968:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787580113.689903:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7e97c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3315:1874413262820096:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787580113.690410:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262820352 00000100:00100000:1.0:1787580113.690418:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262820352 00000100:00100000:1.0:1787580113.690469:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787580113.690477:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae50728000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+17:3316:x1874413262820352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787580113.690490:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787580113.690518:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fae74ed9000/0xc86deac208337741 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc86deac20833773a expref: 17 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580113.690532:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787580113.690570:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae50728000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+16:3316:x1874413262820352:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (1190us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580113.690577:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787580113.690627:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d5b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3316:1874413262820352:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787580113.690926:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580113.690980:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580113.691007:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262820096 00000100:00100000:0.0:1787580113.691012:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262820096 00000100:00100000:0.0:1787580113.691038:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262819968 00000100:00100000:0.0:1787580113.691041:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262819968 00000100:00100000:0.0:1787580113.691060:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787580113.691066:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d14d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+17:3315:x1874413262820096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787580113.691074:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787580113.691099:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fae48db9600/0xc86deac208337963 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc86deac20833795c expref: 17 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580113.691109:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787580113.691139:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d14d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+16:3315:x1874413262820096:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580113.691145:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787580113.691159:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787580113.691166:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d14f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+15:3314:x1874413262819968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787580113.691174:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787580113.691183:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fae41661a00/0xc86deac208337668 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc86deac208337661 expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580113.691196:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787580113.691222:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d14f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4373e6ff-5428-48a2-95c7-e4d05b6f69ed+14:3314:x1874413262819968:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580113.691228:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787580113.691255:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7e97c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3315:1874413262820096:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787580113.691273:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7e97f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3314:1874413262819968:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1787580113.691686:0:12995:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8fae77932000), last request at 1787580110 00000020:00000080:2.0:1787580113.691694:0:12995:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc86deac20833755e 00000100:00080000:2.0:1787580113.691702:0:12995:0:(import.c:65:import_set_state_nolock()) ffff8fae77935000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1787580113.691852:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787580113.691887:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8fae5068d800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1787580113.691937:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8fae5068a800 for lustre-MDT0000 00000020:00080000:0.0:1787580113.692011:0:12995:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8fae77932000): rc 0 00000020:00000080:0.0:1787580113.692014:0:12995:0:(genops.c:885:class_export_put()) final put ffff8fae77932000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:0.0:1787580113.692040:0:12995:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa1578145fae0 00000100:00080000:0.0:1787580113.692066:0:12995:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787580113.692070:0:12995:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:0.0:1787580113.692082:0:12995:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1787580113.692152:0:12995:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1787580113.692171:0:12995:0:(import.c:65:import_set_state_nolock()) ffff8fad42b64000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1787580113.692187:0:12995:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787580113.692189:0:12995:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:0.0:1787580113.692199:0:12995:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1787580113.692261:0:12995:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1787580113.692269:0:12995:0:(import.c:65:import_set_state_nolock()) ffff8fad41109000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1787580113.692295:0:12995:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8fae50310000) has no exports 00000020:00000080:1.0:1787580113.692601:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8fae77932000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1787580113.692646:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8fae77935000 for lustre-MDT0000 00010000:00010000:3.0:1787580113.692833:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787580113.692855:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7e97f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1874413262820480:0@lo:9:umount.0 00000100:00100000:3.0:1787580113.692916:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787580113.693036:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262820480 00000100:00100000:2.0:1787580113.693043:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262820480 00000100:00100000:2.0:1787580113.693105:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787580113.693115:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae507b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874413262820480:12345-0@lo:9:umount.0 00000020:00000080:2.0:1787580113.693138:0:6705:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc86deac2083375ab 00000100:00080000:2.0:1787580113.693145:0:6705:0:(import.c:65:import_set_state_nolock()) ffff8fad411c3000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787580113.693179:0:6705:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00080000:1.0:1787580113.693359:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787580113.693614:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7e97c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1874413262820608:0@lo:9:umount.0 00010000:00010000:1.0:1787580113.693675:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787580113.694109:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae507b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3313:x1874413262820480:12345-0@lo:9:umount.0 Request processed in 994us (1190us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580113.694120:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787580113.694185:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787580113.694242:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8fad42b64000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1787580113.694289:0:3313:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000100:00100000:0.0:1787580113.694319:0:10268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262820608 00000100:00100000:0.0:1787580113.694326:0:10268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262820608 00000100:00100000:0.0:1787580113.694374:0:10268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787580113.694417:0:10268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae507b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874413262820608:12345-0@lo:9:umount.0 00000020:00000080:0.0:1787580113.694437:0:10268:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc86deac208337699 00000100:00080000:0.0:1787580113.694443:0:10268:0:(import.c:65:import_set_state_nolock()) ffff8fae5ff3d800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787580113.694471:0:10268:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:0.0:1787580113.694799:0:10268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae507b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3313:x1874413262820608:12345-0@lo:9:umount.0 Request processed in 417us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580113.694806:0:10268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:1.0:1787580113.695110:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787580113.695133:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787580113.695321:0:3313:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787580113.695328:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7e97f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1874413262820480:0@lo:9:umount.0 00000100:00080000:3.0:1787580113.695349:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8fad41109000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1787580113.695365:0:3313:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1787580113.695367:0:3313:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787580113.695370:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7e97c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1874413262820608:0@lo:9:umount.0 00000020:00080000:1.0:1787580113.702966:0:12995:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8fae50310000) has no exports 00000020:00000080:1.0:1787580113.769099:0:12995:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc86deac208337470 00000020:00000080:1.0:1787580113.769116:0:12995:0:(genops.c:885:class_export_put()) final put ffff8fae7467a800/lustre-QMT0000_UUID 00000020:01000000:1.0:1787580113.769139:0:12995:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1787580113.769288:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8fae7467a800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1787580113.769319:0:12995:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787580113.769329:0:12995:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787580113.769333:0:12995:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff8fae74decd28) has no exports 00000020:00000080:2.0:1787580113.769613:0:12995:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc86deac208337469 00000020:00000080:2.0:1787580113.769632:0:12995:0:(genops.c:885:class_export_put()) final put ffff8fae74df0800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787580113.769695:0:12995:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787580113.769701:0:12995:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1787580113.769704:0:12995:0:(genops.c:885:class_export_put()) final put ffff8fae7f61b000/lustre-QMT0000_UUID 00000020:00000080:2.0:1787580113.769715:0:12995:0:(genops.c:844:class_export_destroy()) destroying export ffff8fae7f61b000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1787580113.769721:0:12995:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:0.0:1787580113.770290:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8fae74df0800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1787580113.770359:0:12995:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8fae50eaf480 - data ffff8fae70c23000/ffff8fae6d1dec00 00000020:01000000:2.0:1787580113.770541:0:12995:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8fae4573c6c0 - data ffff8fae70c69d80/ffff8fae437d4400 00000001:00000004:2.0:1787580113.787620:0:12995:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:2.0:1787580113.896276:0:12995:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787580113.896285:0:12995:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1787580113.896315:0:12995:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787580113.896318:0:12995:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1787580113.897649:0:6734:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1787580113.897656:0:6734:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:2.0:1787580113.897666:0:6734:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1787580113.898607:0:12995:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787580113.898613:0:12995:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:0.0:1787580113.898632:0:12995:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787580113.898634:0:12995:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1787580113.899166:0:8000:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1787580113.899172:0:8000:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:2.0:1787580113.899181:0:8000:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1787580113.984711:0:12995:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc86deac208337438 00000020:00000080:1.0:1787580113.984723:0:12995:0:(genops.c:885:class_export_put()) final put ffff8fae746b8000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787580113.985546:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8fae746b8000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787580113.986097:0:12995:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc86deac20833744d 00000020:00000080:1.0:1787580113.986105:0:12995:0:(genops.c:885:class_export_put()) final put ffff8fae7f618000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1787580113.986123:0:12995:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1787580113.986130:0:12995:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787580113.986139:0:12995:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787580113.986144:0:12995:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff8fae50313370) has no exports 00000004:01000000:1.0:1787580113.986302:0:12995:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1787580113.986313:0:12995:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc86deac20833768b 00000020:00000080:1.0:1787580113.986318:0:12995:0:(genops.c:885:class_export_put()) final put ffff8fae6d1e2000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1787580113.986321:0:12995:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1787580113.986325:0:12995:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787580113.986331:0:12995:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787580113.986334:0:12995:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff8fae5031b370) has no exports 00000020:00000080:1.0:1787580113.986339:0:12995:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc86deac208337684 00000020:00000080:1.0:1787580113.986343:0:12995:0:(genops.c:885:class_export_put()) final put ffff8fad4110b800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787580113.986612:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8fae7f618000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:0.0:1787580113.986621:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8fae6d1e2000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1787580113.986624:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8fad4110b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1787580113.986929:0:12995:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1787580113.986934:0:12995:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787580113.986938:0:12995:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:1.0:1787580113.986945:0:12995:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787580113.986948:0:12995:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787580113.987023:0:12995:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787580113.987031:0:12995:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787580113.987037:0:12995:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc86deac2083375a4 00000020:00000080:1.0:1787580113.987042:0:12995:0:(genops.c:885:class_export_put()) final put ffff8fad42d17000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787580113.987343:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8fad41109000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1787580113.987361:0:8:0:(genops.c:885:class_export_put()) final put ffff8fae7f373800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787580113.987363:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8fae7f373800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1787580113.987368:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1787580113.987641:0:12995:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1787580113.987647:0:12995:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787580113.987658:0:12995:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787580113.987662:0:12995:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8fae6d544d28) has no exports 00000020:00000080:1.0:1787580113.987669:0:12995:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc86deac20833759d 00000020:00000080:1.0:1787580113.987674:0:12995:0:(genops.c:885:class_export_put()) final put ffff8fae74df3000/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1787580113.988035:0:12995:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1787580113.988039:0:12995:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787580113.988042:0:12995:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:1.0:1787580113.988047:0:12995:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787580113.988048:0:12995:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787580113.988079:0:12995:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787580113.988085:0:12995:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787580113.988112:0:12995:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787580113.988116:0:12995:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787580113.988119:0:12995:0:(genops.c:885:class_export_put()) final put ffff8fae746bf000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787580113.988122:0:12995:0:(genops.c:844:class_export_destroy()) destroying export ffff8fae746bf000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1787580113.988131:0:12995:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787580113.988270:0:12995:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc86deac208337454 00000020:00000080:1.0:1787580113.988276:0:12995:0:(genops.c:885:class_export_put()) final put ffff8fae7f619800/lustre-MDD0000_UUID 00000020:01000000:1.0:1787580113.988280:0:12995:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1787580113.988283:0:12995:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787580113.988287:0:12995:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787580113.988289:0:12995:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff8fae50314d28) has no exports 00000020:00000080:1.0:1787580113.988309:0:12995:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787580113.988312:0:12995:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1787580113.988315:0:12995:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc86deac20833745b 00000020:00000080:1.0:1787580113.988318:0:12995:0:(genops.c:885:class_export_put()) final put ffff8fae7f61f800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1787580113.988324:0:12995:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8fae6a238800 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1787580113.988327:0:12995:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8fae6a238800 3 00000020:01000004:1.0:1787580113.988331:0:12995:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8fae6a238800 from lustre-MDT0000 00000020:00000080:1.0:1787580113.988348:0:12995:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787580113.988350:0:12995:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1787580113.988353:0:12995:0:(genops.c:885:class_export_put()) final put ffff8fae746b9800/lustre-MDT0000_UUID 00000020:00000080:1.0:1787580113.988362:0:12995:0:(genops.c:844:class_export_destroy()) destroying export ffff8fae746b9800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1787580113.988372:0:12995:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1787580113.988551:0:12995:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:1.0:1787580113.988556:0:12995:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1787580113.988560:0:12995:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1787580113.988562:0:12995:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787580113.988565:0:12995:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787580113.988572:0:12995:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8fae50327000 4373e6ff-5428-48a2-95c7-e4d05b6f69ed 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787580113.988587:0:12995:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff8fae5217cd28) has exports, disconnecting them 00000020:00080000:1.0:1787580113.988592:0:12995:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8fae50327000), last request at 1787579865 00000020:00000080:1.0:1787580113.988607:0:12995:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc86deac2083373f2 00000020:00010000:1.0:1787580113.988611:0:12995:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8fae50327000: total 4 00000100:00080000:1.0:1787580113.988615:0:12995:0:(import.c:65:import_set_state_nolock()) ffff8fae50324800 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1787580113.988713:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8fad42d17000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1787580113.988722:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8fae74df3000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787580113.988727:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8fad42b64000 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1787580113.988732:0:8:0:(genops.c:885:class_export_put()) final put ffff8fae6d09b800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787580113.988735:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8fae6d09b800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1787580113.988739:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787580113.988817:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8fae7f619800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1787580113.988821:0:8:0:(genops.c:885:class_export_put()) final put ffff8fae518ba800/lustre-MDD0000_UUID 00000020:00000080:0.0:1787580113.988822:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8fae518ba800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1787580113.988825:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1787580113.988977:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8fae7f61f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00080000:1.0:1787580113.989015:0:12995:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8fae50327000): rc 0 00000020:00080000:1.0:1787580113.989020:0:12995:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff8fae5217cd28) has no exports 00000100:00100000:1.0:1787580113.989093:0:5848:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8fae48dd4400:5848] 2 exiting: rc = 0 00000100:00100000:0.0:1787580113.989252:0:5847:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8fae48dd4c00:5847] 1 exiting: rc = 0 00000020:00010000:2.0:1787580113.989344:0:5842:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8fae50327000: total 0 00010000:00010000:2.0:1787580113.989375:0:5842:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8fae50327000, canceled 0 locks, left on hash table 8. 00010000:00010000:2.0:1787580113.990135:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fae4150e800/0xc86deac208337511 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc86deac20833750a expref: 9 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580113.990157:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fae4ca59c00/0xc86deac20833774f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc86deac208337748 expref: 8 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580113.990167:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fae74ed8c00/0xc86deac208337709 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc86deac208337702 expref: 7 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580113.990177:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fae48db8e00/0xc86deac208337947 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc86deac208337940 expref: 6 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580113.990200:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fae48db9200/0xc86deac208337955 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc86deac20833794e expref: 5 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580113.990211:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fae4ca58c00/0xc86deac2083376fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc86deac2083376f4 expref: 4 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580113.990222:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fae74ed9a00/0xc86deac208337717 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc86deac208337710 expref: 3 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580113.990233:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fae4ca58e00/0xc86deac208337725 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc86deac20833771e expref: 2 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580113.990243:0:5842:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8fae50327000, canceled 8 locks, left on hash table 0. 00000020:00000080:2.0:1787580113.990259:0:5842:0:(genops.c:885:class_export_put()) final put ffff8fae50327000/4373e6ff-5428-48a2-95c7-e4d05b6f69ed 00010000:00010000:2.0:1787580113.990309:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787580113.990312:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787580113.990315:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787580113.990459:0:5845:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8fae521ad400:5845] 0 exiting: rc = 1 00000100:00100000:1.0:1787580113.990895:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580113.990902:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580113.990909:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580113.990916:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580113.990923:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580113.990929:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580113.990936:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580113.990942:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580113.990948:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580113.990955:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580113.990961:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580113.990966:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580113.990972:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580113.990979:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580113.990984:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580113.990990:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580113.990996:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580113.991012:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580113.991018:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580113.991023:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580113.991029:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580113.991034:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580113.991040:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580113.991046:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580113.991051:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580113.991057:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580113.991063:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580113.991069:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580113.991074:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580113.991081:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580113.991086:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580113.991091:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580113.991097:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580113.991102:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580113.991108:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580113.991114:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580113.991119:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580113.991125:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580113.991130:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580113.991136:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580113.991141:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580113.991146:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580113.991150:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580113.991157:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580113.991162:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580113.991167:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580113.991173:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580113.991178:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580113.991183:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580113.991187:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580113.991192:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580113.991197:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580113.991208:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580113.991214:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580113.991219:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580113.991225:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580113.991230:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580113.991235:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580113.991240:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580113.991245:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580113.991251:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580113.991256:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580113.991260:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580113.991266:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:1.0:1787580113.991658:0:12995:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787580113.991662:0:12995:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:00000080:0.0:1787580113.992541:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8fae50327000/4373e6ff-5428-48a2-95c7-e4d05b6f69ed for MGS 00000020:00000080:0.0:1787580113.992586:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8fae50324800 for MGS 00000020:01000000:1.0:1787580113.993012:0:12995:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8fae6d116b40 - data ffff8fae70ecc0d8/ffff8fae7f367800 00000020:01000000:1.0:1787580113.993132:0:12995:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8fae52380240 - data ffff8fae6a74e000/ffff8fae50681000 00000020:00000080:0.0:1787580113.993887:0:12995:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc86deac2083373dd 00000020:00000080:0.0:1787580113.993896:0:12995:0:(genops.c:885:class_export_put()) final put ffff8fae51d53800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1787580113.993914:0:12995:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8fae6a238800 from MGS, refs=2 00000020:01000004:0.0:1787580113.993918:0:12995:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8fae6a238800 2 00000020:01000004:0.0:1787580113.993921:0:12995:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8fae6a238800 from MGS 00000020:00000080:0.0:1787580113.993941:0:12995:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787580113.993948:0:12995:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1787580113.993950:0:12995:0:(genops.c:885:class_export_put()) final put ffff8fae50979000/MGS 00000020:00000080:0.0:1787580113.993953:0:12995:0:(genops.c:844:class_export_destroy()) destroying export ffff8fae50979000/MGS for MGS 00000020:01000000:0.0:1787580113.993958:0:12995:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1787580113.994011:0:12995:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1787580113.994015:0:12995:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787580113.994031:0:12995:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787580113.994039:0:12995:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8fae50689000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787580113.994045:0:12995:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff8fae74de99b8) has exports, disconnecting them 00000020:00080000:0.0:1787580113.994049:0:12995:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8fae50689000), last request at 1787579867 00000020:00000080:0.0:1787580113.994054:0:12995:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc86deac2083374a8 00000020:00080000:0.0:1787580113.994064:0:12995:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8fae50689000): rc 0 00000020:00000080:0.0:1787580113.994069:0:12995:0:(genops.c:885:class_export_put()) final put ffff8fae50689000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1787580113.994833:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8fae51d53800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787580113.994844:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8fae50689000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1787580113.995427:0:12995:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1787580113.995432:0:12995:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787580113.995588:0:12995:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787580113.995595:0:12995:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787580113.995745:0:12995:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787580113.995752:0:12995:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1787580113.995758:0:12995:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8fae6a238800 1 00000020:00000080:1.0:1787580113.995765:0:12995:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc86deac2083373cf 00000020:00000080:1.0:1787580113.995771:0:12995:0:(genops.c:885:class_export_put()) final put ffff8fae5097b000/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1787580113.995776:0:12995:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1787580113.995781:0:12995:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787580113.995784:0:12995:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787580113.995787:0:12995:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff8fae52178000) has no exports 00000020:00000080:2.0:1787580113.996112:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8fae5068a000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1787580113.996119:0:37:0:(genops.c:885:class_export_put()) final put ffff8fae74df1000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1787580113.996122:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8fae74df1000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1787580113.996130:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1787580113.996195:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8fae5097b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787580114.042160:0:12995:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787580114.042186:0:12995:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1787580114.042191:0:12995:0:(genops.c:885:class_export_put()) final put ffff8fae5097e000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787580114.042196:0:12995:0:(genops.c:844:class_export_destroy()) destroying export ffff8fae5097e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1787580114.042206:0:12995:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1787580114.042321:0:12995:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8fae6a23f000 00000020:01000000:1.0:1787580114.042345:0:12995:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1787580114.042349:0:12995:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787580114.042355:0:12995:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787580114.042359:0:12995:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff8fae503199b8) has no exports 00000100:00100000:1.0:1787580114.042540:0:8897:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff8fae5f4ee800:8897] 3 exiting: rc = 0 00000100:00100000:0.0:1787580114.045874:0:5853:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff8fae50279a00:5853] 1 exiting: rc = 0 00000100:00100000:3.0:1787580114.047077:0:5852:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff8fae50278000:5852] 0 exiting: rc = 1 00000100:00100000:2.0:1787580114.055638:0:5854:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff8fae48dd5800:5854] 2 exiting: rc = 0 00000100:00100000:1.0:1787580114.055886:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.055894:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.055909:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.055914:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.055920:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.055925:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.055931:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.055935:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.055941:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.055946:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.055951:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.055957:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.055962:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.055967:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.055972:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.055977:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.055983:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.055988:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.055993:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.055998:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.056003:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.056010:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.056015:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.056020:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.056040:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.056045:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.056051:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.056057:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.056062:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.056068:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.056073:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.056079:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.056083:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.056089:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.056094:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.056099:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.056105:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.056111:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.056117:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.056123:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.056128:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.056134:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.056140:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.056145:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.056151:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.056156:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.056161:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.056166:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.056171:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.056177:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.056182:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.056187:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.056193:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.056198:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.056204:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.056209:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.056215:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.056220:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.056225:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.056241:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.056246:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.056252:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.056258:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.056273:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.065565:0:5855:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8fae50eddc00:5855] 0 exiting: rc = 1 00000100:00100000:0.0:1787580114.070092:0:5856:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8fae50258e00:5856] 1 exiting: rc = 0 00000100:00100000:1.0:1787580114.074100:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.074110:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.074117:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.074124:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.074131:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.074138:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.074144:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.074150:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.074157:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.074163:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.074168:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.074174:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.074181:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.074186:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.074192:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.074197:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.074202:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.074207:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.074212:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.074220:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.074225:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.074230:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.074235:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.074240:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.074245:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.074250:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.074254:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.074260:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.074264:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.074268:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.074289:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.074294:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.074299:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.074304:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.074309:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.074315:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.074320:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.074326:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.074331:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.074336:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.074341:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.074345:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.074350:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.074355:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.074361:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.074366:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.074372:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.074377:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.074596:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.074605:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.074611:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.074617:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.074622:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.074628:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.074632:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.074637:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.074641:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.074647:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.074652:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.074656:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.074661:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.074680:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.074685:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.074690:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.075314:0:5857:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff8fae5dcc4600:5857] 0 exiting: rc = 1 00000100:00100000:1.0:1787580114.076151:0:5858:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff8fae5037ac00:5858] 1 exiting: rc = 0 00000100:00100000:0.0:1787580114.077629:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580114.077641:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580114.077647:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580114.077654:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580114.077660:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580114.077666:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580114.077673:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580114.077679:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580114.077684:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580114.077712:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580114.077721:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580114.077726:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580114.077733:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580114.077740:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580114.077748:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580114.077754:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580114.077761:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580114.077768:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580114.077774:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580114.077781:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580114.077800:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580114.077825:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580114.077834:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580114.077842:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580114.077861:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580114.077868:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580114.077874:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580114.077880:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580114.077887:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580114.077895:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580114.078029:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580114.078037:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580114.078044:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580114.078068:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580114.078076:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580114.078082:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580114.078088:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580114.078093:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580114.078099:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580114.078105:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580114.078111:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580114.078117:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580114.078123:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580114.078130:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580114.078136:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580114.078159:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580114.078168:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580114.078175:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580114.078181:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580114.078188:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580114.078193:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580114.078199:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580114.078206:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580114.078212:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580114.078219:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580114.078224:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580114.078230:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580114.078251:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580114.078258:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580114.078272:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580114.078278:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580114.078285:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580114.078291:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580114.078297:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.095077:0:5859:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8fae518dd800:5859] 0 exiting: rc = 1 00000100:00100000:0.0:1787580114.099031:0:5860:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8fae518dde00:5860] 1 exiting: rc = 0 00000100:00100000:1.0:1787580114.099241:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.099248:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.099254:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.099259:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.099265:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.099271:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.099276:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.099281:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.099287:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.099292:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.099298:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.099303:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.099308:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.099313:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.099318:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.099324:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.099329:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.099334:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.099339:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.099345:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.099349:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.099354:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.099359:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.099364:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.099370:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.099375:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.099407:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.099414:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.099420:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.099425:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.099431:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.099506:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.099514:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.099532:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.099538:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.099544:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.099549:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.099555:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.099561:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.099566:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.099570:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.099584:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.099591:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.099597:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.099602:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.099606:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.099611:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.099615:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.099620:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.099625:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.099630:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.099635:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.099640:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.099645:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.099650:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.099654:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.099659:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.099663:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.099668:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.099674:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.099679:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.099683:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.099688:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.099694:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.100181:0:5861:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8fae518dd400:5861] 0 exiting: rc = 1 00000100:00100000:0.0:1787580114.100319:0:5862:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8fae44242800:5862] 1 exiting: rc = 0 00000100:00100000:1.0:1787580114.100529:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.100535:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.100540:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.100556:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.100561:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.100565:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.100570:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.100587:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.100593:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.100598:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.100603:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.100608:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.100614:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.100619:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.100625:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.100631:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.100636:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.100641:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.100646:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.100650:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.100655:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.100659:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.100664:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.100668:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.100672:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.100676:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.100681:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.100686:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.100690:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.100694:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.100699:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.100704:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.100709:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.100714:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.100719:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.100725:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.100730:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.100735:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.100748:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.100753:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.100757:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.100763:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.100767:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.100772:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.100777:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.100782:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.100788:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.100794:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.100799:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.100803:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.100807:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.100812:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.100816:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.100821:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.100826:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.100830:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.100835:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.100839:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.100844:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.100848:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.100853:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.100858:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.100863:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.100867:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000001:00100000:2.0:1787580114.103024:0:6733:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 31d1df27-21ab-4c76-bd19-e53fa778bd7e 00000020:00000080:2.0:1787580114.103033:0:6733:0:(genops.c:885:class_export_put()) final put ffff8fae6d1e3000/31d1df27-21ab-4c76-bd19-e53fa778bd7e 00000001:00100000:2.0:1787580114.103075:0:6733:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787580114.103078:0:6733:0:(genops.c:885:class_export_put()) final put ffff8fad411c2800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787580114.103140:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8fae6d1e3000/31d1df27-21ab-4c76-bd19-e53fa778bd7e for lustre-OST0000 00000020:00000080:1.0:1787580114.103187:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8fad411c2800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1787580114.103204:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8fae6d4a0000 for lustre-OST0000 00000020:00000080:1.0:1787580114.103208:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8fad411c3000 for lustre-OST0000 00000100:00100000:0.0:1787580114.103327:0:5863:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff8fae518dfa00:5863] 0 exiting: rc = 1 00000100:00100000:1.0:1787580114.103570:0:5864:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff8fae518de200:5864] 1 exiting: rc = 0 00000100:00100000:2.0:1787580114.103665:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.103673:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.103679:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.103684:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.103690:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.103695:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.103700:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.103706:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.103712:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.103717:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.103722:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.103728:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.103733:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.103738:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.103745:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.103751:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.103756:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.103761:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.103766:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.103771:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.103776:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.103782:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.103787:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.103793:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.103797:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.103802:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.103807:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.103812:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.103816:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.103821:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.103826:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.103831:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.103837:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.103842:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.103849:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.103864:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.103869:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.103874:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.103878:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.103883:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.103887:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.103892:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.103897:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.103912:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.103917:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.103922:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.103928:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.103932:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.103937:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.103941:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.103947:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.103952:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.103956:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.103960:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.103965:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.103969:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.103974:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.103978:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.103982:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.103987:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.103992:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.103997:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.104003:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.104008:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580114.105174:0:5865:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff8fae740aec00:5865] 0 exiting: rc = 1 00000100:00100000:1.0:1787580114.105376:0:5866:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff8fae740ae400:5866] 1 exiting: rc = 0 00000100:00100000:0.0:1787580114.105716:0:5867:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff8fae518dfe00:5867] 2 exiting: rc = 0 00000100:00100000:2.0:1787580114.106309:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.106316:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.106323:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.106328:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.106334:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.106341:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.106376:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.106762:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.106769:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.106774:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.106779:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.106784:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.106789:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.106795:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.106801:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.106806:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.106811:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.106817:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.106822:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.106827:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.106833:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.106838:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.106843:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.106849:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.106854:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.106859:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.106864:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.106870:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.106875:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.106880:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.107012:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.107021:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.107028:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.107033:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.107039:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.107045:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.107051:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.107056:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.107062:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.107067:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.107073:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.107087:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.107093:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.107098:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.107104:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.107109:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.107117:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.107122:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.107127:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.107133:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.107138:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.107144:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.107149:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.107154:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.107174:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.107183:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.107188:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.107195:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.107202:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.107207:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.107213:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.107219:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.107224:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787580114.107229:0:12995:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1787580114.115634:0:12995:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787580114.115647:0:12995:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1787580114.115653:0:12995:0:(genops.c:885:class_export_put()) final put ffff8fae50705800/MDS_uuid 00000020:00000080:2.0:1787580114.115658:0:12995:0:(genops.c:844:class_export_destroy()) destroying export ffff8fae50705800/MDS_uuid for MDS 00000020:01000000:2.0:1787580114.115667:0:12995:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1787580114.115779:0:12995:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1787580114.422643:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787580115.445994:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787580115.572574:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5072b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3314:1874413262820736:0@lo:400:kworker.0 00000100:00100000:1.0:1787580115.572604:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5072a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1874413262820992:0@lo:400:kworker.0 00000400:00000100:1.0:1787580115.572647:0:3316:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874413262820992 offset 0 length 224: 4 00000100:00100000:3.0:1787580115.572682:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5072ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1874413262820864:0@lo:400:kworker.0 00000400:00000100:0.0:1787580115.579597:0:3314:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874413262820736 offset 0 length 224: 4 00000400:00000100:3.0:1787580115.582714:0:3315:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874413262820864 offset 0 length 224: 4 00010000:00010000:0.0:1787580116.473736:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787580116.816816:0:13146:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1787580116.831849:0:13146:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1787580116.831899:0:13146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae50fea200/0xc86deac208337710 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208337717 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580116.831914:0:13146:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae50fea200/0xc86deac208337710 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc86deac208337717 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580116.831922:0:13146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae50fea200/0xc86deac208337710 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xc86deac208337717 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580116.831930:0:13146:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.136@tcp lock: ffff8fae50fea200/0xc86deac208337710 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xc86deac208337717 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580116.831952:0:13146:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787580116.831958:0:13146:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1787580116.831980:0:13146:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787580116.831991:0:13146:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8fae5072ad80 x1874413262820864/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787580131 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787580116.832008:0:13146:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00100000:3.0:1787580116.832042:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5072ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1874413262820864:0@lo:400:kworker.0 00000100:00080000:3.0:1787580116.832071:0:13146:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787580116.832095:0:13146:0:(import.c:65:import_set_state_nolock()) ffff8fae5068b000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1787580116.832120:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae507b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3313:1874413262821120:0@lo:39:umount.0 00000400:00000100:3.0:1787580116.832166:0:3313:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874413262821120 offset 0 length 224: 4 00010000:00010000:0.0:1787580116.832780:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787580116.832788:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.136@tcp lock: ffff8fae50fea200/0xc86deac208337710 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xc86deac208337717 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580116.832796:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae50fea200 already unused, calling callback (ffffffffc1b77c20) 10000000:00010000:0.0:1787580116.832800:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.136@tcp lock: ffff8fae50fea200/0xc86deac208337710 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xc86deac208337717 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580116.832808:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: ffff8fae50fea200/0xc86deac208337710 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xc86deac208337717 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787580116.832815:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: ffff8fae50fea200/0xc86deac208337710 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xc86deac208337717 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787580116.832821:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787580116.832823:0:5842:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787580116.832826:0:5842:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787580116.832853:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.136@tcp lock: ffff8fae50fea200/0xc86deac208337710 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xc86deac208337717 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580116.832874:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787580116.832899:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.136@tcp lock: ffff8fae50fea200/0xc86deac208337710 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xc86deac208337717 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580116.832905:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: ffff8fae50fea200/0xc86deac208337710 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xc86deac208337717 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580116.832916:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787580116.832918:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787580116.832919:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787580116.832930:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787580116.832941:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7e97e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3316:1874413262821248:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787580116.832983:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580116.833025:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262821248 00000100:00100000:0.0:1787580116.833033:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262821248 00000100:00100000:0.0:1787580116.833072:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787580116.833080:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7e97ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3316:x1874413262821248:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1787580116.833087:0:5838:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787580116 with bad export cookie 14442457699129193458 00000100:00100000:0.0:1787580116.848493:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7e97ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3316:x1874413262821248:12345-0@lo:103:ldlm_bl.0 Request processed in 15403us (15501us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787580116.848507:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1787580116.848960:0:3316:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.136@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787580116.848965:0:3316:0:(import.c:65:import_set_state_nolock()) ffff8fae521de000 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1787580116.848969:0:3316:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.136@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:3.0:1787580116.857205:0:3316:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.136@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1787580116.857228:0:3316:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1787580116.857238:0:3316:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8fae5072b100 x1874413262820736/t0(0) o400->MGC192.168.202.136@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787580131 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787580116.857272:0:3316:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8fae7e97e680 x1874413262821248/t0(0) o103->MGC192.168.202.136@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787580132 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1787580116.857282:0:3316:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1787580116.857285:0:3316:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1787580116.857286:0:3316:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1787580116.857289:0:3316:0:(import.c:65:import_set_state_nolock()) ffff8fae521de000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787580116.857293:0:3316:0:(import.c:510:import_select_connection()) MGC192.168.202.136@tcp: connect to NID 0@lo last attempt 213 00000100:00080000:3.0:1787580116.857302:0:3316:0:(import.c:624:import_select_connection()) MGC192.168.202.136@tcp: import ffff8fae521de000 using connection 192.168.202.136@tcp/0@lo 00000100:00100000:3.0:1787580116.857333:0:3316:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fae507ba300 x1874413262821376/t0(0) o250->MGC192.168.202.136@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787580116.857364:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7e97e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3316:1874413262821248:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787580116.857663:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5072b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3314:1874413262820736:0@lo:400:kworker.0 00000100:00100000:2.0:1787580116.857947:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae507ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3313:1874413262821376:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:2.0:1787580116.857994:0:3313:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874413262821376 offset 0 length 520: 4 00010000:00010000:2.0:1787580117.491929:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787580118.185016:0:7653:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787580118.185028:0:7653:0:(genops.c:885:class_export_put()) final put ffff8fae5ff38800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787580118.185103:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8fae5ff38800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1787580118.185153:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8fae5ff3d800 for lustre-OST0001 00010000:00010000:2.0:1787580118.515756:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787580119.540752:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787580120.564379:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787580120.693002:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 4373e6ff-5428-48a2-95c7-e4d05b6f69ed->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787580120.693013:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 4373e6ff-5428-48a2-95c7-e4d05b6f69ed->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787580120.693097:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae507b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874413262821504:0@lo:400:kworker.0 00000400:00000100:1.0:1787580120.693273:0:3314:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874413262821504 offset 0 length 224: 4 00010000:00010000:2.0:1787580121.588137:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787580121.715672:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 4373e6ff-5428-48a2-95c7-e4d05b6f69ed->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787580121.715684:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 4373e6ff-5428-48a2-95c7-e4d05b6f69ed->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787580121.716651:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787580121.716676:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae507bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874413262821632:0@lo:400:kworker.0 00000400:00000100:1.0:1787580121.716736:0:3314:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874413262821632 offset 0 length 224: 4 00010000:00010000:2.0:1787580122.614143:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787580123.635523:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787580124.661717:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787580125.687912:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787580126.323517:0:3313:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787580116/real 1787580116] req@ffff8fae507ba300 x1874413262821376/t0(0) o250->MGC192.168.202.136@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787580126 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787580126.323551:0:3313:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8fae507ba300 x1874413262821376/t0(0) o250->MGC192.168.202.136@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787580126 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787580126.323563:0:3313:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787580116/real 1787580116] req@ffff8fae507b8e00 x1874413262821120/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787580126 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787580126.323595:0:3313:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8fae507b8e00 x1874413262821120/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787580126 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787580126.323614:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8fae521de000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787580126.323633:0:3313:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1787580126.323637:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae507ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3313:1874413262821376:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:3.0:1787580126.323643:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8fae5068b000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1787580126.323668:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae507b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3313:1874413262821120:0@lo:39:umount.0 00000100:00080000:1.0:1787580126.323787:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 4373e6ff-5428-48a2-95c7-e4d05b6f69ed->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787580126.323793:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1787580126.323796:0:8:0:(import.c:65:import_set_state_nolock()) ffff8fae521de000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787580126.323801:0:8:0:(import.c:510:import_select_connection()) MGC192.168.202.136@tcp: connect to NID 0@lo last attempt 464 00000100:00080000:1.0:1787580126.323813:0:8:0:(import.c:589:import_select_connection()) MGC192.168.202.136@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787580126.323875:0:8:0:(import.c:624:import_select_connection()) MGC192.168.202.136@tcp: import ffff8fae521de000 using connection 192.168.202.136@tcp/0@lo 00000100:00100000:1.0:1787580126.323909:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fae5072b100 x1874413262821760/t0(0) o250->MGC192.168.202.136@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787580126.324017:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5072b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3313:1874413262821760:0@lo:250:kworker.0 00000400:00000100:3.0:1787580126.324058:0:3313:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874413262821760 offset 0 length 520: 4 00000100:00100000:2.0:1787580126.324879:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787580126.324893:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae50729f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1874413262821888:0@lo:400:kworker.0 00000400:00000100:2.0:1787580126.324924:0:3317:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874413262821888 offset 0 length 224: 4 00000100:00080000:0.0:1787580126.325505:0:13146:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787580126.325511:0:13146:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787580126.325518:0:13146:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787580126.328188:0:13146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae4150f600/0xc86deac20833771e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208337725 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580126.328209:0:13146:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae4150f600/0xc86deac20833771e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc86deac208337725 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580126.328217:0:13146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae4150f600/0xc86deac20833771e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xc86deac208337725 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580126.328225:0:13146:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.136@tcp lock: ffff8fae4150f600/0xc86deac20833771e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xc86deac208337725 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580126.328257:0:13146:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787580126.328266:0:13146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae4ca59000/0xc86deac20833794e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208337955 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580126.328275:0:13146:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae4ca59000/0xc86deac20833794e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc86deac208337955 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580126.328282:0:13146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae4ca59000/0xc86deac20833794e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc86deac208337955 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580126.328288:0:13146:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.136@tcp lock: ffff8fae4ca59000/0xc86deac20833794e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc86deac208337955 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580126.328524:0:13146:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1787580126.328529:0:13146:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1787580126.328561:0:13146:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1787580126.328566:0:13146:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1787580126.328571:0:13146:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787580126.328583:0:13146:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787580126.328601:0:13146:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8fae74deb370) has no exports 00000020:00080000:0.0:1787580126.328634:0:13146:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8fae74deb370) has no exports 00010000:00010000:3.0:1787580126.328966:0:7642:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787580126.328974:0:7642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.136@tcp lock: ffff8fae4150f600/0xc86deac20833771e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xc86deac208337725 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580126.328983:0:7642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae4150f600 already unused, calling callback (ffffffffc1b77c20) 10000000:00010000:3.0:1787580126.328987:0:7642:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.136@tcp lock: ffff8fae4150f600/0xc86deac20833771e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xc86deac208337725 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580126.328997:0:7642:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: ffff8fae4150f600/0xc86deac20833771e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xc86deac208337725 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787580126.329005:0:7642:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: ffff8fae4150f600/0xc86deac20833771e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xc86deac208337725 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787580126.329012:0:7642:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787580126.329015:0:7642:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:3.0:1787580126.329024:0:7642:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:3.0:1787580126.329038:0:7642:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8fae521de000 00010000:00010000:3.0:1787580126.329042:0:7642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.136@tcp lock: ffff8fae4150f600/0xc86deac20833771e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xc86deac208337725 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580126.329051:0:7642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: ffff8fae4150f600/0xc86deac20833771e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xc86deac208337725 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580126.329076:0:7642:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787580126.329080:0:7642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.136@tcp lock: ffff8fae4ca59000/0xc86deac20833794e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc86deac208337955 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580126.329087:0:7642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae4ca59000 already unused, calling callback (ffffffffc1b77c20) 10000000:00010000:3.0:1787580126.329090:0:7642:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.136@tcp lock: ffff8fae4ca59000/0xc86deac20833794e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc86deac208337955 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580126.329097:0:7642:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: ffff8fae4ca59000/0xc86deac20833794e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xc86deac208337955 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787580126.329105:0:7642:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: ffff8fae4ca59000/0xc86deac20833794e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xc86deac208337955 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787580126.329111:0:7642:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1787580126.329113:0:7642:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1787580126.329115:0:7642:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1787580126.329120:0:7642:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8fae521de000 00010000:00010000:3.0:1787580126.329123:0:7642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.136@tcp lock: ffff8fae4ca59000/0xc86deac20833794e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc86deac208337955 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580126.329129:0:7642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: ffff8fae4ca59000/0xc86deac20833794e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc86deac208337955 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580126.329159:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787580126.329161:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787580126.329163:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787580126.330438:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1787580126.337270:0:13146:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8fae6d116000 - data ffff8fae77c7caf8/ffff8fae7f367000 00000020:01000000:1.0:1787580126.337487:0:13146:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8fae50205cc0 - data ffff8fae70e4b0d8/ffff8fae6d711800 00100000:10000000:1.0:1787580126.364082:0:13146:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1787580126.416581:0:13146:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc86deac20833752d 00000020:00000080:3.0:1787580126.416590:0:13146:0:(genops.c:885:class_export_put()) final put ffff8fae74df4000/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1787580126.416617:0:13146:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8fae50613000 from lustre-OST0000, refs=2 00000020:01000004:3.0:1787580126.416620:0:13146:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8fae50613000 2 00000020:01000004:3.0:1787580126.416623:0:13146:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8fae50613000 from lustre-OST0000 00000020:00000080:3.0:1787580126.416651:0:13146:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787580126.416662:0:13146:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1787580126.416665:0:13146:0:(genops.c:885:class_export_put()) final put ffff8fae74df3800/lustre-OST0000_UUID 00000020:00000080:3.0:1787580126.416669:0:13146:0:(genops.c:844:class_export_destroy()) destroying export ffff8fae74df3800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1787580126.416675:0:13146:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1787580126.416719:0:13146:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1787580126.416725:0:13146:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1787580126.416729:0:13146:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787580126.416735:0:13146:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787580126.416741:0:13146:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8fae6d09d800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787580126.416747:0:13146:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff8fae6d540000) has exports, disconnecting them 00000020:00080000:3.0:1787580126.416752:0:13146:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8fae6d09d800), last request at 1787579889 00000020:00000080:3.0:1787580126.416756:0:13146:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc86deac208337557 00000020:00080000:3.0:1787580126.416765:0:13146:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8fae6d09d800): rc 0 00000020:00000080:3.0:1787580126.416770:0:13146:0:(genops.c:885:class_export_put()) final put ffff8fae6d09d800/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1787580126.417491:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8fae74df4000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1787580126.417507:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8fae6d09d800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1787580126.425186:0:13146:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1787580126.425198:0:13146:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787580126.425205:0:13146:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787580126.425214:0:13146:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787580126.425463:0:13146:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787580126.425483:0:13146:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:2.0:1787580126.425492:0:13146:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8fae50613000 1 00000020:00000080:2.0:1787580126.425500:0:13146:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc86deac2083374e7 00000020:00000080:2.0:1787580126.425511:0:13146:0:(genops.c:885:class_export_put()) final put ffff8fae50b5a800/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1787580126.425518:0:13146:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1787580126.425523:0:13146:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787580126.425529:0:13146:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787580126.425533:0:13146:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff8fae6d543370) has no exports 00000020:00000080:0.0:1787580126.426125:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8fae5068b000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1787580126.426135:0:37:0:(genops.c:885:class_export_put()) final put ffff8fae6d09b000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1787580126.426139:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8fae6d09b000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1787580126.426147:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1787580126.426206:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8fae50b5a800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1787580126.504515:0:13146:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787580126.504533:0:13146:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1787580126.504538:0:13146:0:(genops.c:885:class_export_put()) final put ffff8fae7403b800/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1787580126.504553:0:13146:0:(genops.c:844:class_export_destroy()) destroying export ffff8fae7403b800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1787580126.504570:0:13146:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1787580126.504737:0:13146:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8fae50613800 00000020:02000400:0.0:1787580126.504783:0:13146:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1787580126.711840:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787580127.737254:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787580128.755590:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787580129.507635:0:13301:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1787580129.517894:0:13301:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1787580129.520456:0:13301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae4150fc00/0xc86deac2083376f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac2083376fb expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580129.520538:0:13301:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae4150fc00/0xc86deac2083376f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc86deac2083376fb expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580129.520547:0:13301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae4150fc00/0xc86deac2083376f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc86deac2083376fb expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580129.520573:0:13301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.136@tcp lock: ffff8fae4150fc00/0xc86deac2083376f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc86deac2083376fb expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580129.520597:0:13301:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787580129.520604:0:13301:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1787580129.520631:0:13301:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787580129.520644:0:13301:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8fae5072a680 x1874413262820992/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787580131 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787580129.520658:0:13301:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8fae507b8380 x1874413262821504/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787580136 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787580129.520674:0:13301:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8fae507bb480 x1874413262821632/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787580137 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787580129.520683:0:13301:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8fae50729f80 x1874413262821888/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787580142 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787580129.520697:0:13301:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:2.0:1787580129.520732:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae50729f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1874413262821888:0@lo:400:kworker.0 00000100:00080000:2.0:1787580129.520768:0:13301:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787580129.520794:0:13301:0:(import.c:65:import_set_state_nolock()) ffff8fae6d1e4000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1787580129.520800:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae507bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874413262821632:0@lo:400:kworker.0 00000100:00100000:1.0:1787580129.520808:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae507b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874413262821504:0@lo:400:kworker.0 00010000:00010000:0.0:1787580129.520925:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787580129.520933:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.136@tcp lock: ffff8fae4150fc00/0xc86deac2083376f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc86deac2083376fb expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580129.520941:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae4150fc00 already unused, calling callback (ffffffffc1b77c20) 10000000:00010000:0.0:1787580129.520945:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.136@tcp lock: ffff8fae4150fc00/0xc86deac2083376f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc86deac2083376fb expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580129.520954:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: ffff8fae4150fc00/0xc86deac2083376f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc86deac2083376fb expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787580129.520970:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: ffff8fae4150fc00/0xc86deac2083376f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc86deac2083376fb expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787580129.520977:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787580129.520979:0:5841:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787580129.520988:0:5841:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787580129.521003:0:5841:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8fae521de000 00010000:00010000:0.0:1787580129.521008:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.136@tcp lock: ffff8fae4150fc00/0xc86deac2083376f4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc86deac2083376fb expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580129.521014:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: ffff8fae4150fc00/0xc86deac2083376f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc86deac2083376fb expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580129.521026:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787580129.521028:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787580129.521030:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787580129.521048:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5072a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3316:1874413262820992:0@lo:400:kworker.0 00000100:00100000:3.0:1787580129.522278:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d5b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3313:1874413262822016:0@lo:39:umount.0 00000400:00000100:3.0:1787580129.522333:0:3313:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874413262822016 offset 0 length 224: 4 00010000:00010000:3.0:1787580129.780194:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787580130.805195:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787580131.446502:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 4373e6ff-5428-48a2-95c7-e4d05b6f69ed->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787580131.446515:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 4373e6ff-5428-48a2-95c7-e4d05b6f69ed->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1787580131.827871:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787580132.852108:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787580133.876061:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787580134.906220:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787580135.923851:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787580136.563801:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 4373e6ff-5428-48a2-95c7-e4d05b6f69ed->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787580136.563813:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 4373e6ff-5428-48a2-95c7-e4d05b6f69ed->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1787580136.947566:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787580137.971920:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787580138.997536:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787580139.763559:0:3313:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787580129/real 1787580129] req@ffff8fae6d5b8a80 x1874413262822016/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787580139 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787580139.763628:0:3313:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8fae6d5b8a80 x1874413262822016/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787580139 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787580139.763648:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8fae6d1e4000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1787580139.763739:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d5b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3313:1874413262822016:0@lo:39:umount.0 00000100:00080000:2.0:1787580139.775465:0:13301:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787580139.775475:0:13301:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787580139.775482:0:13301:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1787580139.777317:0:13301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae4ca59400/0xc86deac208337702 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208337709 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580139.777340:0:13301:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae4ca59400/0xc86deac208337702 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc86deac208337709 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580139.777473:0:13301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae4ca59400/0xc86deac208337702 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc86deac208337709 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580139.777480:0:13301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.136@tcp lock: ffff8fae4ca59400/0xc86deac208337702 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc86deac208337709 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580139.777509:0:13301:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787580139.777517:0:13301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae4ca59800/0xc86deac208337940 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208337947 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580139.777524:0:13301:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae4ca59800/0xc86deac208337940 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc86deac208337947 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580139.777790:0:13301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae4ca59800/0xc86deac208337940 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc86deac208337947 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580139.777800:0:13301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.136@tcp lock: ffff8fae4ca59800/0xc86deac208337940 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc86deac208337947 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580139.777951:0:13301:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1787580139.777958:0:13301:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1787580139.777989:0:13301:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1787580139.777994:0:13301:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1787580139.778000:0:13301:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787580139.778006:0:13301:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787580139.778010:0:13301:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8fae7e9d8000) has no exports 00000020:00080000:2.0:1787580139.778039:0:13301:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8fae7e9d8000) has no exports 00000020:01000000:2.0:1787580139.779932:0:13301:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8fae6d1168a0 - data ffff8fae77c2a948/ffff8fae50738c00 00000020:01000000:2.0:1787580139.780073:0:13301:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8fae51ef7f00 - data ffff8fad416495e8/ffff8fae6d180000 00010000:00010000:1.0:1787580139.781969:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787580139.781984:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.136@tcp lock: ffff8fae4ca59400/0xc86deac208337702 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc86deac208337709 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580139.781995:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae4ca59400 already unused, calling callback (ffffffffc1b77c20) 10000000:00010000:1.0:1787580139.781999:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.136@tcp lock: ffff8fae4ca59400/0xc86deac208337702 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc86deac208337709 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580139.782010:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: ffff8fae4ca59400/0xc86deac208337702 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xc86deac208337709 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787580139.782017:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: ffff8fae4ca59400/0xc86deac208337702 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xc86deac208337709 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787580139.782022:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787580139.782025:0:5841:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:1.0:1787580139.782028:0:5841:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:1.0:1787580139.782048:0:5841:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8fae521de000 00010000:00010000:1.0:1787580139.782052:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.136@tcp lock: ffff8fae4ca59400/0xc86deac208337702 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc86deac208337709 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580139.782058:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: ffff8fae4ca59400/0xc86deac208337702 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc86deac208337709 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580139.782071:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787580139.782074:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.136@tcp lock: ffff8fae4ca59800/0xc86deac208337940 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc86deac208337947 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580139.782097:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae4ca59800 already unused, calling callback (ffffffffc1b77c20) 10000000:00010000:1.0:1787580139.782100:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.136@tcp lock: ffff8fae4ca59800/0xc86deac208337940 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc86deac208337947 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580139.782106:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: ffff8fae4ca59800/0xc86deac208337940 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xc86deac208337947 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787580139.782111:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: ffff8fae4ca59800/0xc86deac208337940 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xc86deac208337947 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787580139.782116:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787580139.782118:0:5841:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1787580139.782120:0:5841:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1787580139.782126:0:5841:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8fae521de000 00010000:00010000:1.0:1787580139.782129:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.136@tcp lock: ffff8fae4ca59800/0xc86deac208337940 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xc86deac208337947 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580139.782134:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: ffff8fae4ca59800/0xc86deac208337940 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xc86deac208337947 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580139.782145:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787580139.782148:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787580139.782150:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787580139.784232:0:7642:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1787580139.800107:0:13301:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1787580139.908245:0:13301:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc86deac2083375f8 00000020:00000080:1.0:1787580139.908263:0:13301:0:(genops.c:885:class_export_put()) final put ffff8fae77931000/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1787580139.908288:0:13301:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8fae77937800 from lustre-OST0001, refs=2 00000020:01000004:1.0:1787580139.908292:0:13301:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8fae77937800 2 00000020:01000004:1.0:1787580139.908295:0:13301:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8fae77937800 from lustre-OST0001 00000020:00000080:1.0:1787580139.908320:0:13301:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787580139.908356:0:13301:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1787580139.908360:0:13301:0:(genops.c:885:class_export_put()) final put ffff8fad411c1000/lustre-OST0001_UUID 00000020:00000080:1.0:1787580139.908363:0:13301:0:(genops.c:844:class_export_destroy()) destroying export ffff8fad411c1000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1787580139.908370:0:13301:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:1.0:1787580139.908577:0:13301:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 4373e6ff-5428-48a2-95c7-e4d05b6f69ed->MGS 00010000:00010000:1.0:1787580139.908594:0:13301:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: ffff8fae50feba00/0xc86deac20833750a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc86deac208337511 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787580139.908608:0:13301:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: ffff8fae50feba00/0xc86deac20833750a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc86deac208337511 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787580139.908618:0:13301:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1787580139.908620:0:13301:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1787580139.908625:0:13301:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1787580139.908642:0:13301:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8fae521de000 00010000:00010000:1.0:1787580139.908645:0:13301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: ffff8fae50feba00/0xc86deac20833750a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc86deac208337511 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580139.908660:0:13301:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: ffff8fae74ed8a00/0xc86deac208337748 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc86deac20833774f expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787580139.908668:0:13301:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: ffff8fae74ed8a00/0xc86deac208337748 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc86deac20833774f expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787580139.908673:0:13301:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787580139.908675:0:13301:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1787580139.908676:0:13301:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1787580139.908685:0:13301:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8fae521de000 00010000:00010000:1.0:1787580139.908688:0:13301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: ffff8fae74ed8a00/0xc86deac208337748 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc86deac20833774f expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787580139.908703:0:13301:0:(import.c:65:import_set_state_nolock()) ffff8fae521de000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1787580139.908713:0:13301:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1787580139.908715:0:13301:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1787580139.908717:0:13301:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1787580139.908720:0:13301:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1787580139.908733:0:13301:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8fae5072b100 x1874413262821760/t0(0) o250->MGC192.168.202.136@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787580141 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1787580139.908750:0:13301:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1787580139.908754:0:13301:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 2s for inflight to error out 00000100:00100000:3.0:1787580139.908964:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5072b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4373e6ff-5428-48a2-95c7-e4d05b6f69ed:3313:1874413262821760:0@lo:250:kworker.0 00000020:00000080:0.0:1787580139.909190:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8fae77931000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 10000000:01000000:1.0:1787580139.909323:0:13301:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1787580139.909331:0:13301:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc86deac2083373eb 00000020:00000080:1.0:1787580139.909336:0:13301:0:(genops.c:885:class_export_put()) final put ffff8fae50704000/4373e6ff-5428-48a2-95c7-e4d05b6f69ed 00000020:01000000:1.0:1787580139.909361:0:13301:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.136@tcp (flags='') 00000020:00000080:1.0:1787580139.909366:0:13301:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787580139.909371:0:13301:0:(obd_config.c:956:class_cleanup()) MGC192.168.202.136@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787580139.909375:0:13301:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff8fae503119b8) has no exports 10000000:01000000:3.0:1787580139.909554:0:5850:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1787580139.909643:0:13301:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.202.136@tcp: client import never connected 00000100:00080000:1.0:1787580139.909646:0:13301:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1787580139.909648:0:13301:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1787580139.909650:0:13301:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1787580139.909652:0:13301:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1787580139.909686:0:13301:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787580139.909691:0:13301:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.136@tcp (uuid 4373e6ff-5428-48a2-95c7-e4d05b6f69ed) 00000020:01000000:1.0:1787580139.909697:0:13301:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1787580139.909700:0:13301:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787580139.909703:0:13301:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787580139.909718:0:13301:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8fae6d1e5800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787580139.909724:0:13301:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff8fae74de8000) has exports, disconnecting them 00000020:00080000:1.0:1787580139.909728:0:13301:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8fae6d1e5800), last request at 1787579912 00000020:00000080:1.0:1787580139.909733:0:13301:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc86deac208337622 00000020:00080000:1.0:1787580139.909744:0:13301:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8fae6d1e5800): rc 0 00000020:00000080:1.0:1787580139.909748:0:13301:0:(genops.c:885:class_export_put()) final put ffff8fae6d1e5800/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1787580139.910320:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8fae50704000/4373e6ff-5428-48a2-95c7-e4d05b6f69ed for MGC192.168.202.136@tcp 00000020:00000080:0.0:1787580139.910329:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8fae521de000 for MGC192.168.202.136@tcp 00000020:00000080:0.0:1787580139.910335:0:8:0:(genops.c:885:class_export_put()) final put ffff8fae4403a000/4373e6ff-5428-48a2-95c7-e4d05b6f69ed 00000020:00000080:0.0:1787580139.910337:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8fae4403a000/4373e6ff-5428-48a2-95c7-e4d05b6f69ed for MGC192.168.202.136@tcp 00000020:01000000:0.0:1787580139.910341:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.136@tcp (4373e6ff-5428-48a2-95c7-e4d05b6f69ed) 00000020:00000080:0.0:1787580139.910605:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8fae6d1e5800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1787580139.916854:0:13301:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1787580139.916865:0:13301:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787580139.916871:0:13301:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787580139.916879:0:13301:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1787580139.918851:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00000020:00000080:3.0:1787580139.919012:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8fae6d1e4000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:3.0:1787580139.921143:0:7643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:3.0:1787580139.922823:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:3.0:1787580139.923412:0:7642:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:0.0:1787580139.923585:0:5837:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8fae43777200:5837] 1 exiting: rc = 0 00000100:00100000:3.0:1787580139.924074:0:5836:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8fae43777c00:5836] 0 exiting: rc = 1 00000100:00100000:0.0:1787580139.924200:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.924519:0:5838:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8fae43760a00:5838] 0 exiting: rc = 1 00000100:00100000:3.0:1787580139.925154:0:5840:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8fae50ee3c00:5840] 2 exiting: rc = 0 00000100:00100000:1.0:1787580139.928410:0:5839:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8fae52378200:5839] 1 exiting: rc = 0 00000100:00100000:3.0:1787580139.928643:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787580139.928652:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787580139.928658:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787580139.928664:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787580139.928679:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787580139.928686:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787580139.928706:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787580139.928719:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787580139.928726:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787580139.928731:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787580139.928737:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787580139.928748:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787580139.928754:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787580139.928805:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787580139.928812:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787580139.928818:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787580139.928826:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787580139.928831:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787580139.928844:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787580139.928850:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787580139.928855:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787580139.928860:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787580139.928866:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787580139.928871:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787580139.928876:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787580139.928882:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787580139.928887:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787580139.928892:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787580139.928898:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787580139.928902:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787580139.928907:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787580139.928913:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787580139.928918:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787580139.928923:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787580139.928927:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787580139.928932:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787580139.928936:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787580139.928941:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787580139.928945:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787580139.928950:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787580139.928955:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787580139.928965:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787580139.929123:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787580139.929132:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787580139.929138:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787580139.929143:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787580139.929149:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787580139.929154:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787580139.929159:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787580139.929164:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787580139.929309:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787580139.929317:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787580139.929322:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787580139.929328:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787580139.929332:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787580139.929337:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787580139.929342:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787580139.929358:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787580139.929363:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787580139.929367:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787580139.929372:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787580139.929376:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787580139.929380:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787580139.929406:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1787580139.931261:0:13301:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787580139.931272:0:13301:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1787580139.931277:0:13301:0:(genops.c:885:class_export_put()) final put ffff8fae6d1e6000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1787580139.931281:0:13301:0:(genops.c:844:class_export_destroy()) destroying export ffff8fae6d1e6000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1787580139.931292:0:13301:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:0.0:1787580139.931329:0:13301:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8fae77937800 1 00000020:00000080:0.0:1787580139.931335:0:13301:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc86deac2083375c7 00000020:00000080:0.0:1787580139.931341:0:13301:0:(genops.c:885:class_export_put()) final put ffff8fae7f374800/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1787580139.931361:0:13301:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1787580139.931370:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8fae7f374800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1787580139.931400:0:13301:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787580139.931404:0:13301:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787580139.931408:0:13301:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff8fae5217b370) has no exports 00000020:00000080:0.0:1787580139.954452:0:13301:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787580139.954471:0:13301:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1787580139.954478:0:13301:0:(genops.c:885:class_export_put()) final put ffff8fae77930800/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1787580139.954483:0:13301:0:(genops.c:844:class_export_destroy()) destroying export ffff8fae77930800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1787580139.954495:0:13301:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1787580139.954768:0:13301:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8fae77936000 00000020:01000000:0.0:1787580139.954791:0:13301:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1787580139.954796:0:13301:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787580139.954800:0:13301:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787580139.954805:0:13301:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff8fae521799b8) has no exports 00000020:00000080:0.0:1787580139.954828:0:13301:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787580139.954845:0:13301:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1787580139.954849:0:13301:0:(genops.c:885:class_export_put()) final put ffff8fae50b5b000/OSS_uuid 00000020:00000080:0.0:1787580139.954852:0:13301:0:(genops.c:844:class_export_destroy()) destroying export ffff8fae50b5b000/OSS_uuid for OSS 00000020:01000000:0.0:1787580139.954858:0:13301:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:0.0:1787580139.954951:0:10268:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff8fae5f834c00:10268] 3 exiting: rc = 0 00000100:00100000:0.0:1787580139.955446:0:6707:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff8fae492fe000:6707] 1 exiting: rc = 0 00000100:00080000:1.0:1787580139.959497:0:5849:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1787580139.961927:0:6705:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff8fae56ab5600:6705] 0 exiting: rc = 1 00000100:00100000:2.0:1787580139.962056:0:6708:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff8fae492fe600:6708] 2 exiting: rc = 0 00000100:00100000:0.0:1787580139.962237:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.962246:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.962251:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.962257:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.962263:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.962268:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.962273:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.962278:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.962284:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.962289:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.962295:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.962300:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.962320:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.962326:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.962331:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.962336:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.962341:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.962358:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.962363:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.962368:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.962373:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.962378:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.962416:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.962422:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.962427:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.962433:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.962439:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.962444:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.962449:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.962454:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.962459:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.962465:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.962470:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.962474:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.962491:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.962497:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.962502:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.962507:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.962511:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.962516:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.962521:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.962526:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.962531:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.962536:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.962541:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.962546:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.962551:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.962556:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.962561:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.962566:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.962571:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.962577:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.962582:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.962588:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.962593:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.962598:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.962604:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.962609:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.962614:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.962619:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.962625:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.962631:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.962636:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.962641:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787580139.965827:0:12906:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff8fad425a3800:12906] 2 exiting: rc = 0 00000100:00100000:2.0:1787580139.966271:0:6709:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8fae43760200:6709] 0 exiting: rc = 1 00000100:00100000:2.0:1787580139.966364:0:6710:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8fae43761200:6710] 1 exiting: rc = 0 00000100:00100000:0.0:1787580139.966748:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.966758:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.966764:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.966770:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.966776:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.966793:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.966799:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.966804:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.966809:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.966814:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.966819:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.966824:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.966828:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.966833:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.966851:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.966856:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.966861:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.966867:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.966872:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.966877:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.966882:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.966887:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.966891:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.966896:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.966902:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.966907:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.966912:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.966917:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.966922:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.966927:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.966932:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.966937:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.966943:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.966948:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.966952:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.966958:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.966963:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.966977:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.966984:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.966988:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.967000:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.967005:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.967011:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.967016:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.967020:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.967026:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.967031:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.967037:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.967042:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.967047:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.967053:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.967058:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.967064:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.967069:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.967075:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.967080:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.967085:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.967090:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.967095:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.967101:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.967107:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.967112:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.967117:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.967122:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787580139.969750:0:6711:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8fae43760600:6711] 0 exiting: rc = 1 00000100:00100000:3.0:1787580139.969940:0:6713:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8fae7ed43600:6713] 2 exiting: rc = 0 00000100:00100000:0.0:1787580139.971329:0:6712:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8fae7ed42800:6712] 1 exiting: rc = 0 00000100:00100000:0.0:1787580139.973767:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.973777:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.973782:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.973789:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.973795:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.973800:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.973805:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.973811:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.973816:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.973822:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.974577:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.974584:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.974601:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.974607:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.974612:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.974649:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.974655:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.974660:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.974674:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.974682:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.974690:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.974696:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.974701:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.974706:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.974720:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.974726:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.974732:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.974737:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.974742:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.974747:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.974752:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.974756:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.974763:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.974768:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.974774:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.974779:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.974799:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.974806:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.974812:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.974817:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.974822:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.974828:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.974834:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.975036:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.975045:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.975067:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.975073:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.975079:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.975085:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.975091:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.975096:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.975102:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.975108:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.975115:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.975120:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.975125:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.975131:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.975137:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.975143:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.975149:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.975156:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.975162:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.975230:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580139.975239:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787580140.001933:0:6714:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8fae7ed43800:6714] 0 exiting: rc = 1 00000100:00100000:1.0:1787580140.002337:0:6715:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8fae7ed43e00:6715] 1 exiting: rc = 0 00000100:00100000:0.0:1787580140.002571:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.002579:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.002585:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.002591:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.002596:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.002601:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.002606:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.002611:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.002639:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.002644:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.002649:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.002654:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.002659:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.002663:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.002680:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.002684:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.002702:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.002707:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.002721:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.002726:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.002731:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.002736:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.002741:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.002746:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.002752:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.002758:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.002762:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.002767:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.002773:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.002778:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.002782:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.002787:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.002792:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.002796:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.002802:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.002807:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.002812:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.002817:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.002821:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.002826:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.002852:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.002858:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.002862:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.002867:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.002872:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.002877:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.002882:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.002887:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.002892:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.002898:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.002905:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.002918:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.002923:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.002929:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.002934:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.002939:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.002944:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.002950:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.002955:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.002960:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.002965:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.002981:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.002986:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.002991:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787580140.004148:0:6716:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8fae4355d200:6716] 0 exiting: rc = 1 00000100:00100000:1.0:1787580140.008245:0:6717:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8fae48726000:6717] 1 exiting: rc = 0 00000100:00100000:0.0:1787580140.014105:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.014116:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.014121:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.014127:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.014132:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.014138:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.014144:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.014150:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.014156:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.014161:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.014179:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.014187:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.014218:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.014225:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.014231:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.014237:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.014243:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.014249:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.014255:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.014261:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.014267:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.014273:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.014296:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.014306:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.014330:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.014338:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.014355:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.014363:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.014370:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.014377:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.014398:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.014405:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.014411:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.014417:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.014423:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.014428:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.014449:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.014457:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.014464:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.014469:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.014477:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.014484:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.014490:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.014501:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.014508:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.014514:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.014521:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.014827:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.014920:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.014928:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.014934:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.014940:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.014946:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.014951:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.014957:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.014963:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.015034:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.015051:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.015058:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.015065:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.015089:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.015096:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.015103:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787580140.015110:0:13301:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1787580140.039413:0:13301:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1787580157.014124:0:13916:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg236-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1787580166.327559:0:14377:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787580166.327564:0:14377:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1787580166.327672:0:14377:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8fae50b5d800 00000020:01000004:0.0:1787580166.327687:0:14377:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1787580166.327694:0:14377:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1787580166.327708:0:14377:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8fae74de8000) 00000020:00000080:0.0:1787580166.327719:0:14377:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1787580166.341854:0:14377:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1787580166.343999:0:14377:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:1.0:1787580166.344458:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 97: rc = 0 00100000:10000000:1.0:1787580166.344556:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 97: rc = 0 00100000:10000000:1.0:1787580166.344746:0:14377:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1787580166.344812:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 97: rc = 0 00100000:10000000:1.0:1787580166.344909:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 97: rc = 0 00100000:10000000:1.0:1787580166.345173:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 97: rc = 0 00100000:10000000:1.0:1787580166.345268:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 97: rc = 0 00100000:10000000:1.0:1787580166.345640:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 403: rc = 0 00100000:10000000:1.0:1787580166.346818:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 588: rc = 0 00100000:10000000:1.0:1787580166.346920:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 588: rc = 0 00100000:10000000:1.0:1787580166.347662:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 597: rc = 0 00100000:10000000:1.0:1787580166.348012:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 597: rc = 0 00100000:10000000:1.0:1787580166.348356:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 597: rc = 0 00100000:10000000:1.0:1787580166.348624:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 597: rc = 0 00100000:10000000:1.0:1787580166.348867:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 597: rc = 0 00100000:10000000:1.0:1787580166.349262:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 597: rc = 0 00100000:10000000:1.0:1787580166.349643:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 597: rc = 0 00100000:10000000:1.0:1787580166.349891:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 597: rc = 0 00100000:10000000:1.0:1787580166.350300:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 597: rc = 0 00100000:10000000:1.0:1787580166.350604:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 597: rc = 0 00100000:10000000:1.0:1787580166.350842:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 597: rc = 0 00100000:10000000:1.0:1787580166.351232:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 597: rc = 0 00100000:10000000:1.0:1787580166.351710:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 619: rc = 0 00100000:10000000:1.0:1787580166.352025:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 619: rc = 0 00100000:10000000:1.0:1787580166.352347:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 619: rc = 0 00100000:10000000:1.0:1787580166.352619:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 619: rc = 0 00100000:10000000:1.0:1787580166.352858:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 619: rc = 0 00100000:10000000:1.0:1787580166.353277:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 619: rc = 0 00100000:10000000:1.0:1787580166.353769:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 619: rc = 0 00100000:10000000:1.0:1787580166.354158:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 619: rc = 0 00100000:10000000:1.0:1787580166.354419:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 619: rc = 0 00100000:10000000:1.0:1787580166.354674:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 619: rc = 0 00100000:10000000:1.0:1787580166.354913:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 619: rc = 0 00100000:10000000:1.0:1787580166.355368:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 619: rc = 0 00100000:10000000:1.0:1787580166.355711:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 619: rc = 0 00100000:10000000:1.0:1787580166.356704:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 619: rc = 0 00100000:10000000:1.0:1787580166.357173:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 619: rc = 0 00100000:10000000:1.0:1787580166.358156:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 619: rc = 0 00100000:10000000:1.0:1787580166.358454:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 619: rc = 0 00100000:10000000:1.0:1787580166.358718:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 619: rc = 0 00100000:10000000:1.0:1787580166.360247:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 619: rc = 0 00100000:10000000:1.0:1787580166.360560:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 619: rc = 0 00100000:10000000:1.0:1787580166.360814:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 619: rc = 0 00100000:10000000:1.0:1787580166.362498:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 619: rc = 0 00100000:10000000:1.0:1787580166.362764:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 619: rc = 0 00100000:10000000:1.0:1787580166.363860:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 619: rc = 0 00100000:10000000:1.0:1787580166.364914:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 619: rc = 0 00100000:10000000:1.0:1787580166.365463:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 619: rc = 0 00100000:10000000:1.0:1787580166.365712:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 619: rc = 0 00100000:10000000:1.0:1787580166.365989:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 619: rc = 0 00100000:10000000:1.0:1787580166.366262:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 619: rc = 0 00100000:10000000:1.0:1787580166.366559:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 619: rc = 0 00100000:10000000:1.0:1787580166.366815:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 619: rc = 0 00100000:10000000:1.0:1787580166.367065:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 619: rc = 0 00100000:10000000:1.0:1787580166.367531:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 103: rc = 0 00100000:10000000:1.0:1787580166.368014:0:14377:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:1.0:1787580166.370750:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 593: rc = 0 00100000:10000000:1.0:1787580166.371262:0:14377:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:1.0:1787580166.371335:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 593: rc = 0 00100000:10000000:1.0:1787580166.371628:0:14377:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:1.0:1787580166.371697:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 593: rc = 0 00100000:10000000:1.0:1787580166.372223:0:14377:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:1.0:1787580166.372294:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 589: rc = 0 00100000:10000000:1.0:1787580166.372513:0:14377:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:1.0:1787580166.372660:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 589: rc = 0 00100000:10000000:1.0:1787580166.372848:0:14377:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:1.0:1787580166.372915:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 589: rc = 0 00000020:00000080:1.0:1787580166.373353:0:14377:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1787580166.373362:0:14377:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787580166.373375:0:14377:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc86deac2083386ec 00000020:01000004:1.0:1787580166.373505:0:14377:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:1.0:1787580166.373512:0:14377:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1787580166.373518:0:14377:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8fae50b5d800 from MGS 00000020:01000004:1.0:1787580166.373531:0:14377:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1787580166.373542:0:14377:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8fae50318000) 00000020:00000080:1.0:1787580166.373553:0:14377:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1787580166.373687:0:14377:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8fae50b5d800 from MGS, refs=2 00080000:01000000:1.0:1787580166.373692:0:14377:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787580166.373697:0:14377:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc86deac2083386fa 00000100:00100000:1.0:1787580166.373801:0:14377:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1787580166.374016:0:14377:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1787580166.374024:0:14377:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1787580166.374733:0:14377:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1787580166.374740:0:14377:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1787580166.375690:0:14377:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787580166.375849:0:14377:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1787580166.375855:0:14377:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1787580166.376628:0:14377:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1787580166.376636:0:14377:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1787580166.377340:0:14377:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1787580166.377347:0:14377:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1787580166.378197:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787580166.378201:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787580166.378202:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787580166.378534:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787580166.378537:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787580166.378544:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787580166.379261:0:14377:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1787580166.383182:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1787580166.389838:0:14377:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1787580166.393268:0:14377:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787580166.393280:0:14377:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1787580166.398790:0:14386:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1787580166.399147:0:14377:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1787580166.399253:0:14377:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787580166.401843:0:14377:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1787580166.405094:0:14377:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787580166.405281:0:14377:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1787580166.405288:0:14377:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1787580166.412729:0:14377:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1787580166.412746:0:14377:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1787580166.413321:0:14377:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1787580166.413329:0:14377:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1787580166.414451:0:14377:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1787580166.414477:0:14377:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.136@tcp' 00000020:01000004:3.0:1787580166.414479:0:14377:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1787580166.414517:0:14377:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.136@tcp (typ=mgc) 00000020:00000080:3.0:1787580166.414531:0:14377:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.136@tcp (ffff8fae6d5419b8) 00000020:00000080:3.0:1787580166.414548:0:14377:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1787580166.414621:0:14377:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8fae5ff3a800@MGC192.168.202.136@tcp: add connection 192.168.202.136@tcp at head 00010000:00010000:3.0:1787580166.414993:0:14377:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.136@tcp-0 is initialized 00000040:01000000:3.0:1787580166.415001:0:14377:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.136@tcp ctxt 1 is initialized 00000100:00080000:2.0:1787580166.415565:0:14391:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1787580166.418654:0:14393:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1787580166.418706:0:14377:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.136@tcp (uuid 5949e638-96f6-489a-aea1-b9b80ed3224f) 00000020:00000080:0.0:1787580166.419078:0:14377:0:(genops.c:1385:class_connect()) connect: client 5949e638-96f6-489a-aea1-b9b80ed3224f, cookie 0xc86deac208338708 00000100:00080000:0.0:1787580166.419090:0:14377:0:(import.c:510:import_select_connection()) MGC192.168.202.136@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787580166.419103:0:14377:0:(import.c:624:import_select_connection()) MGC192.168.202.136@tcp: import ffff8fae5ff3a800 using connection 192.168.202.136@tcp/0@lo 00000100:00100000:0.0:1787580166.419145:0:14377:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fae7e97fb80 x1874413262822144/t0(0) o250->MGC192.168.202.136@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787580166.419172:0:14377:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 5949e638-96f6-489a-aea1-b9b80ed3224f->MGS 00000020:01000004:0.0:1787580166.419191:0:14377:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1787580166.419213:0:14377:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1787580166.419227:0:14377:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8fae74deb370) 00000020:00000080:0.0:1787580166.419241:0:14377:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1787580166.423311:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7e97fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5949e638-96f6-489a-aea1-b9b80ed3224f:3313:1874413262822144:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1787580166.423440:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787580166.429915:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262822144 00000100:00100000:2.0:1787580166.429944:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262822144 00000100:00100000:2.0:1787580166.429985:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787580166.429994:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3313:x1874413262822144:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1787580166.430022:0:14388:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 5949e638-96f6-489a-aea1-b9b80ed3224f@0@lo t0 exp 0000000000000000 cur 514 last 0 00000020:00000080:2.0:1787580166.430054:0:14388:0:(genops.c:1385:class_connect()) connect: client 5949e638-96f6-489a-aea1-b9b80ed3224f, cookie 0xc86deac208338716 00000100:00080000:2.0:1787580166.430206:0:14388:0:(import.c:65:import_set_state_nolock()) ffff8fae6d4a5000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787580166.430306:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5949e638-96f6-489a-aea1-b9b80ed3224f+5:3313:x1874413262822144:12345-0@lo:250:mount.lustre.0 Request processed in 311us (6865us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580166.430314:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787580166.431200:0:3313:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.202.136@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1787580166.431212:0:3313:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.136@tcp: connect to target with instance 0 00000100:00080000:1.0:1787580166.431219:0:3313:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.136@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1787580166.431226:0:3313:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1787580166.431229:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8fae5ff3a800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1787580166.431232:0:3313:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1787580166.431245:0:3313:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1787580166.431251:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7e97fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5949e638-96f6-489a-aea1-b9b80ed3224f:3313:1874413262822144:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1787580166.439415:0:14377:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787580166.439661:0:14377:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1787580166.439670:0:14377:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1787580166.440611:0:14377:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1787580166.440626:0:14377:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1787580166.441872:0:14377:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1787580166.441881:0:14377:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1787580166.442584:0:14377:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787580166.442746:0:14377:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1787580166.442750:0:14377:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1787580166.444363:0:14377:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1787580166.444374:0:14377:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1787580166.493517:0:14377:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787580166.493874:0:14377:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1787580166.493883:0:14377:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1787580166.495235:0:14377:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1787580166.495246:0:14377:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1787580166.497534:0:14377:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787580166.497730:0:14377:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787580166.497736:0:14377:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1787580166.499440:0:14377:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787580166.499453:0:14377:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1787580166.500099:0:14377:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787580166.500295:0:14377:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787580166.500301:0:14377:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1787580166.501037:0:14377:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787580166.501045:0:14377:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1787580166.502077:0:14377:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787580166.502239:0:14377:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787580166.502245:0:14377:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1787580166.503577:0:14377:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787580166.503588:0:14377:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1787580166.528466:0:14377:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787580166.528701:0:14377:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1787580166.528708:0:14377:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1787580166.530621:0:14377:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1787580166.530635:0:14377:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1787580166.536925:0:14377:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1787580166.536942:0:14377:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1787580166.546840:0:14377:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1787580166.546889:0:14377:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1787580166.546897:0:14377:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.136@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1787580166.547046:0:14377:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.136@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787580166.547091:0:14377:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.136@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1787580166.547095:0:14377:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787580166.547097:0:14377:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787580166.547099:0:14377:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787580166.547100:0:14377:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787580166.547101:0:14377:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787580166.547102:0:14377:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787580166.547104:0:14377:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787580166.547115:0:14377:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787580166.547117:0:14377:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787580166.547118:0:14377:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787580166.547121:0:14377:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1787580166.547123:0:14377:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787580166.547125:0:14377:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787580166.547126:0:14377:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787580166.547127:0:14377:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787580166.547134:0:14377:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787580166.547135:0:14377:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787580166.547136:0:14377:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787580166.547137:0:14377:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787580166.547138:0:14377:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787580166.547139:0:14377:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787580166.547180:0:14377:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787580166.547201:0:14377:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae507b8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:14377:1874413262822272:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787580166.547282:0:14377:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580166.547336:0:14377:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae49ef0000 going to sleep for 11 seconds 00000100:00100000:2.0:1787580166.548130:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262822272 00000100:00100000:2.0:1787580166.548141:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262822272 00000100:00100000:2.0:1787580166.548201:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787580166.548212:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5949e638-96f6-489a-aea1-b9b80ed3224f+5:14377:x1874413262822272:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787580166.548278:0:14390:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787580166.548281:0:14390:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1787580166.548284:0:14390:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1787580166.548757:0:14411:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1787580166.549858:0:14390:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:1.0:1787580166.554741:0:14412:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1787580166.554751:0:14412:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1787580166.554754:0:14412:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1787580166.554788:0:14412:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:2.0:1787580166.555265:0:14390:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787580166.555280:0:14390:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1787580166.578594:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5949e638-96f6-489a-aea1-b9b80ed3224f+5:14377:x1874413262822272:12345-0@lo:253:mount.lustre.0 Request processed in 30371us (31299us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580166.578614:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787580166.578619:0:14377:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae507b8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:14377:1874413262822272:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787580166.578636:0:14377:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787580166.578640:0:14377:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787580166.578641:0:14377:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787580166.578643:0:14377:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787580166.578644:0:14377:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787580166.578645:0:14377:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787580166.578646:0:14377:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787580166.578647:0:14377:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787580166.578649:0:14377:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787580166.578651:0:14377:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787580166.578652:0:14377:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787580166.578676:0:14377:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8fae50b5d800 from lustre-MDT0000 10000000:01000000:3.0:1787580166.578703:0:14377:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1787580166.578705:0:14377:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787580166.578710:0:14377:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8fae6d5419b8 10000000:01000000:3.0:1787580166.578715:0:14377:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787580166.578723:0:14377:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8fae6d5419b8 from 1 10000000:01000000:3.0:1787580166.578726:0:14377:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787580166.578763:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae5f6d7e00/0xc86deac20833871d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580166.578774:0:14377:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff8fae5f6d7e00/0xc86deac20833871d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580166.578800:0:14377:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff8fae5f6d7e00/0xc86deac20833871d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580166.578819:0:14377:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae507b8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:14377:1874413262822400:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787580166.578854:0:14377:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580166.578894:0:14377:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae49ef0180 going to sleep for 11 seconds 00000100:00100000:0.0:1787580166.578978:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262822400 00000100:00100000:0.0:1787580166.578985:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262822400 00000100:00100000:0.0:1787580166.579028:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787580166.579046:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5949e638-96f6-489a-aea1-b9b80ed3224f+5:14377:x1874413262822400:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787580166.579060:0:14389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787580166.579079:0:14389:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fae50feb600/0xc86deac208338724 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc86deac20833871d expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580166.579104:0:14389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fae50feb600/0xc86deac208338724 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc86deac20833871d expref: 6 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580166.579136:0:14389:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fae50feb600/0xc86deac208338724 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac20833871d expref: 6 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580166.579144:0:14389:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae50feb600, rc 0) 00000100:00100000:0.0:1787580166.579182:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5949e638-96f6-489a-aea1-b9b80ed3224f+6:14377:x1874413262822400:12345-0@lo:101:mount.lustre.0 Request processed in 146us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580166.579188:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787580166.579220:0:14377:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae507b8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:14377:1874413262822400:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787580166.579234:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff8fae5f6d7e00/0xc86deac20833871d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208338724 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580166.579242:0:14377:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff8fae5f6d7e00/0xc86deac20833871d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc86deac208338724 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580166.579287:0:14377:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae507b8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:14377:1874413262822528:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787580166.579311:0:14377:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580166.579330:0:14377:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae49ef0180 going to sleep for 11 seconds 00000100:00100000:0.0:1787580166.579375:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262822528 00000100:00100000:0.0:1787580166.579380:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262822528 00000100:00100000:0.0:1787580166.579423:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787580166.579429:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5949e638-96f6-489a-aea1-b9b80ed3224f+6:14377:x1874413262822528:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787580166.579659:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5949e638-96f6-489a-aea1-b9b80ed3224f+6:14377:x1874413262822528:12345-0@lo:501:mount.lustre.0 Request processed in 229us (347us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787580166.579666:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787580166.579714:0:14377:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae507b8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:14377:1874413262822528:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1787580166.579743:0:14377:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787580166.579761:0:14377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae5f6d7e00/0xc86deac20833871d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208338724 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580166.579769:0:14377:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff8fae5f6d7e00/0xc86deac20833871d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208338724 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787580166.579777:0:14377:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8fae50b5d800 10000000:01000000:3.0:1787580166.579782:0:14377:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787580166.579791:0:14377:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8fae50b5d800 10000000:01000000:3.0:1787580166.579794:0:14377:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1787580166.579796:0:14377:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8fae50b5d800 from 1 10000000:01000000:3.0:1787580166.579798:0:14377:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1787580166.579814:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae5f6d6e00/0xc86deac20833872b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580166.579821:0:14377:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff8fae5f6d6e00/0xc86deac20833872b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580166.579829:0:14377:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff8fae5f6d6e00/0xc86deac20833872b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580166.579842:0:14377:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae507b8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:14377:1874413262822656:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787580166.579867:0:14377:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580166.579890:0:14377:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae49ef0180 going to sleep for 11 seconds 00000100:00100000:0.0:1787580166.579945:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262822656 00000100:00100000:0.0:1787580166.579949:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262822656 00000100:00100000:0.0:1787580166.579977:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787580166.579984:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5949e638-96f6-489a-aea1-b9b80ed3224f+6:14377:x1874413262822656:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787580166.579991:0:14389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787580166.580001:0:14389:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fae50fea800/0xc86deac208338732 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc86deac20833872b expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580166.580015:0:14389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fae50fea800/0xc86deac208338732 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc86deac20833872b expref: 7 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580166.580024:0:14389:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fae50fea800/0xc86deac208338732 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac20833872b expref: 7 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580166.580486:0:14389:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae50fea800, rc 0) 00000100:00100000:0.0:1787580166.580519:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5949e638-96f6-489a-aea1-b9b80ed3224f+7:14377:x1874413262822656:12345-0@lo:101:mount.lustre.0 Request processed in 535us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580166.580525:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787580166.580535:0:14377:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae507b8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:14377:1874413262822656:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787580166.580546:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff8fae5f6d6e00/0xc86deac20833872b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208338732 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580166.580555:0:14377:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff8fae5f6d6e00/0xc86deac20833872b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc86deac208338732 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787580166.580581:0:14377:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1787580166.580594:0:14377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae5f6d6e00/0xc86deac20833872b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208338732 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580166.580600:0:14377:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff8fae5f6d6e00/0xc86deac20833872b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208338732 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787580166.580617:0:14377:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787580166.580621:0:14377:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787580166.580625:0:14377:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8fae50b5d800 10000000:01000000:3.0:1787580166.580627:0:14377:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1787580166.580630:0:14377:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1787580166.580632:0:14377:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787580166.580646:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae5f6d7600/0xc86deac208338739 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580166.580652:0:14377:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff8fae5f6d7600/0xc86deac208338739 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580166.580658:0:14377:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff8fae5f6d7600/0xc86deac208338739 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580166.580669:0:14377:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae507b8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:14377:1874413262822784:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787580166.580694:0:14377:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580166.580721:0:14377:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae49ef0180 going to sleep for 11 seconds 00000100:00100000:0.0:1787580166.580850:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262822784 00000100:00100000:0.0:1787580166.580864:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262822784 00000100:00100000:0.0:1787580166.580894:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787580166.580902:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5949e638-96f6-489a-aea1-b9b80ed3224f+7:14377:x1874413262822784:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787580166.580910:0:14390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787580166.580917:0:14390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fae50febe00/0xc86deac208338740 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc86deac208338739 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580166.580931:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fae50febe00/0xc86deac208338740 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc86deac208338739 expref: 8 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580166.580939:0:14390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fae50febe00/0xc86deac208338740 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac208338739 expref: 8 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580166.580946:0:14390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae50febe00, rc 0) 00000100:00100000:0.0:1787580166.580982:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5949e638-96f6-489a-aea1-b9b80ed3224f+8:14377:x1874413262822784:12345-0@lo:101:mount.lustre.0 Request processed in 81us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580166.580988:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787580166.581032:0:14377:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae507b8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:14377:1874413262822784:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787580166.581043:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff8fae5f6d7600/0xc86deac208338739 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208338740 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580166.581050:0:14377:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff8fae5f6d7600/0xc86deac208338739 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc86deac208338740 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580166.581093:0:14377:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5072aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:14377:1874413262822912:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787580166.581148:0:14377:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787580166.581169:0:14377:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae45eed9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787580166.581269:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262822912 00000100:00100000:3.0:1787580166.581273:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262822912 00000100:00100000:3.0:1787580166.581347:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787580166.581356:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5949e638-96f6-489a-aea1-b9b80ed3224f+8:14377:x1874413262822912:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787580166.581752:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5949e638-96f6-489a-aea1-b9b80ed3224f+9:14377:x1874413262822912:12345-0@lo:501:mount.lustre.0 Request processed in 397us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580166.581759:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787580166.581841:0:14377:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5072aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:14377:1874413262822912:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787580166.581878:0:14377:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5072aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:14377:1874413262823040:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787580166.581917:0:14377:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787580166.591558:0:14377:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae45eed9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787580166.594400:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262823040 00000100:00100000:0.0:1787580166.594418:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262823040 00000100:00100000:0.0:1787580166.594495:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787580166.594506:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5949e638-96f6-489a-aea1-b9b80ed3224f+9:14377:x1874413262823040:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787580166.595203:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5949e638-96f6-489a-aea1-b9b80ed3224f+9:14377:x1874413262823040:12345-0@lo:503:mount.lustre.0 Request processed in 697us (13283us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580166.595220:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787580166.595484:0:14377:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5072aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:14377:1874413262823040:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787580166.596523:0:14413:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5072aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5949e638-96f6-489a-aea1-b9b80ed3224f:14413:1874413262823168:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787580166.596668:0:14413:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787580166.596701:0:14413:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae45eedcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787580166.596779:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262823168 00000100:00100000:0.0:1787580166.596785:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262823168 00000100:00100000:0.0:1787580166.596829:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787580166.596839:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5949e638-96f6-489a-aea1-b9b80ed3224f+9:14413:x1874413262823168:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787580166.597418:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5949e638-96f6-489a-aea1-b9b80ed3224f+9:14413:x1874413262823168:12345-0@lo:502:llog_process_th.0 Request processed in 578us (748us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580166.597427:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787580166.597443:0:14413:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5072aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5949e638-96f6-489a-aea1-b9b80ed3224f:14413:1874413262823168:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787580166.597469:0:14413:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787580166.597481:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787580166.597483:0:14413:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787580166.597488:0:14413:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1787580166.597491:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787580166.597505:0:14413:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8fae5031cd28) 00000020:00000080:1.0:1787580166.597524:0:14413:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1787580166.597529:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1787580166.597831:0:14413:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:1.0:1787580166.597842:0:14413:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc86deac20833874e 00000020:00000080:1.0:1787580166.598047:0:14413:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1787580166.598053:0:14413:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787580166.598057:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787580166.598058:0:14413:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787580166.598060:0:14413:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787580166.598063:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787580166.598065:0:14413:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1787580166.598067:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787580166.598075:0:14413:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8fae503199b8) 00000020:00000080:1.0:1787580166.598084:0:14413:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1787580166.598096:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1787580166.598097:0:14413:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1787580166.598100:0:14413:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1787580166.598114:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787580166.598152:0:14413:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8fae50b5d800 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1787580166.598165:0:14413:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8fae5031b370) 00000020:00000080:1.0:1787580166.598173:0:14413:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1787580166.598229:0:14413:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1787580166.598235:0:14413:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc86deac208338763 00000020:00000080:1.0:1787580166.598323:0:14413:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1787580166.598329:0:14413:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1787580166.598333:0:14413:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xc86deac20833876a 00080000:01000000:1.0:1787580166.598338:0:14413:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:1.0:1787580166.598342:0:14413:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc86deac208338771 00010000:00010000:2.0:1787580166.684036:0:14413:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1787580166.684715:0:14413:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:2.0:1787580166.684903:0:14413:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787580166.686314:0:14413:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8fae7e9dcd28) 00000020:00000080:2.0:1787580166.686336:0:14413:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1787580166.686543:0:14413:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787580166.686552:0:14413:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc86deac20833877f 00000020:00000080:2.0:1787580166.690244:0:14413:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1787580166.700318:0:14413:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xc86deac208338786 00000020:00000080:0.0:1787580166.701530:0:14413:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1787580166.701543:0:14413:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787580166.701549:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787580166.701552:0:14413:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1787580166.701555:0:14413:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787580166.701562:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787580166.701564:0:14413:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1787580166.701568:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1787580166.701608:0:14413:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1787580166.701627:0:14413:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787580166.701631:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787580166.701632:0:14413:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1787580166.701635:0:14413:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787580166.701637:0:14413:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:0.0:1787580166.701638:0:14413:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787580166.701640:0:14413:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787580166.701641:0:14413:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787580166.701644:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787580166.701646:0:14413:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787580166.701648:0:14413:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787580166.701651:0:14413:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1787580166.701654:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787580166.701661:0:14413:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1787580166.701666:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787580166.701672:0:14413:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.136@tcp to nid 0x20000c0a8ca88 (192.168.202.136@tcp) 00000020:01000000:0.0:1787580166.701702:0:14413:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787580166.701705:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787580166.701719:0:14413:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8fae74de99b8) 00000020:00000080:0.0:1787580166.701732:0:14413:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1787580166.701737:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787580166.701793:0:14413:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1787580166.701798:0:14413:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:0.0:1787580166.701806:0:14413:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc86deac208338794 00010000:00080000:0.0:1787580166.701838:0:14413:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8fae6a23d000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.136@tcp at head 00010000:00010000:0.0:1787580166.702156:0:14413:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:0.0:1787580166.707956:0:14413:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1787580166.708039:0:14413:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787580166.716058:0:14413:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787580166.716202:0:14413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1787580166.716276:0:14413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1787580166.717288:0:14417:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787580166.717295:0:14417:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1787580166.718896:0:14413:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787580166.718913:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787580166.718949:0:14413:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1787580166.718970:0:14413:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc86deac20833879b 00000100:00080000:2.0:1787580166.718982:0:14413:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787580166.718988:0:14413:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8fae6a23d000 using connection 192.168.202.136@tcp/0@lo 00000100:00100000:2.0:1787580166.719030:0:14413:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fae6d5baa00 x1874413262823296/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787580166.719057:0:14413:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:1.0:1787580166.719279:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d5baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1874413262823296:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1787580166.719338:0:3313:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874413262823296 offset 0 length 520: 4 00000020:01000000:2.0:1787580166.719557:0:14413:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787580166.719562:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787580166.719564:0:14413:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1787580166.719578:0:14413:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787580166.719581:0:14413:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1787580166.719594:0:14413:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787580166.719596:0:14413:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787580166.719598:0:14413:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787580166.719600:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787580166.719602:0:14413:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787580166.719605:0:14413:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787580166.719609:0:14413:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1787580166.719613:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787580166.719614:0:14413:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1787580166.719618:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787580166.719621:0:14413:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.136@tcp to nid 0x20000c0a8ca88 (192.168.202.136@tcp) 00000020:01000000:2.0:1787580166.719646:0:14413:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787580166.719649:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787580166.719663:0:14413:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8fae7e9d99b8) 00000020:00000080:2.0:1787580166.719676:0:14413:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1787580166.719681:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787580166.719761:0:14413:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1787580166.719768:0:14413:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:2.0:1787580166.719774:0:14413:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc86deac2083387a9 00010000:00080000:2.0:1787580166.719804:0:14413:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8fae7f61c000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.136@tcp at head 00010000:00010000:2.0:1787580166.720013:0:14413:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1787580166.720380:0:14413:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1787580166.721022:0:14413:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1787580166.721961:0:14413:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787580166.722036:0:14413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1787580166.722174:0:14413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1787580166.724654:0:14419:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787580166.724664:0:14419:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1787580166.726964:0:14413:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787580166.726982:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787580166.727023:0:14413:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787580166.727045:0:14413:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc86deac2083387b0 00000100:00080000:1.0:1787580166.727057:0:14413:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787580166.727062:0:14413:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8fae7f61c000 using connection 192.168.202.136@tcp/0@lo 00000100:00100000:1.0:1787580166.728246:0:14413:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fae5072aa00 x1874413262823424/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787580166.728338:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5072aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1874413262823424:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1787580166.728503:0:3313:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874413262823424 offset 0 length 520: 4 00000100:00080000:1.0:1787580166.728767:0:14413:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1787580166.728849:0:14413:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787580166.728855:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787580166.728857:0:14413:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1787580166.728874:0:14413:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787580166.728879:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787580166.728880:0:14413:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787580166.728883:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787580166.728885:0:14413:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787580166.728887:0:14413:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787580166.728890:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787580166.728891:0:14413:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787580166.728894:0:14413:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787580166.728896:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787580166.728897:0:14413:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787580166.728901:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787580166.728937:0:14413:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5072a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5949e638-96f6-489a-aea1-b9b80ed3224f:14413:1874413262823552:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787580166.728995:0:14413:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787580166.729032:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262823552 00000100:00100000:1.0:1787580166.729038:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262823552 00000100:00100000:1.0:1787580166.729779:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787580166.729792:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d514850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5949e638-96f6-489a-aea1-b9b80ed3224f+9:14413:x1874413262823552:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787580166.730063:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d514850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5949e638-96f6-489a-aea1-b9b80ed3224f+9:14413:x1874413262823552:12345-0@lo:502:llog_process_th.0 Request processed in 273us (1067us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580166.730084:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787580166.730143:0:14413:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae45eed600 going to sleep for 11 seconds 00000100:00100000:1.0:1787580166.730165:0:14413:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5072a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5949e638-96f6-489a-aea1-b9b80ed3224f:14413:1874413262823552:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787580166.730198:0:14413:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787580166.730203:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787580166.730206:0:14413:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787580166.730211:0:14413:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1787580166.730455:0:14377:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:0.0:1787580166.730474:0:14377:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787580166.730496:0:14377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae5f6d7600/0xc86deac208338739 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208338740 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580166.730507:0:14377:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff8fae5f6d7600/0xc86deac208338739 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208338740 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787580166.730516:0:14377:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8fae50b5d800 from 1 10000000:01000000:0.0:1787580166.730519:0:14377:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787580166.730551:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae50feb200/0xc86deac2083387b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580166.730741:0:14377:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff8fae50feb200/0xc86deac2083387b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580166.730751:0:14377:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff8fae50feb200/0xc86deac2083387b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580166.730768:0:14377:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7e97f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:14377:1874413262823680:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787580166.730804:0:14377:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580166.730846:0:14377:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae50f2ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787580166.730983:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262823680 00000100:00100000:2.0:1787580166.730989:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262823680 00000100:00100000:2.0:1787580166.731026:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787580166.731035:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d515850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5949e638-96f6-489a-aea1-b9b80ed3224f+9:14377:x1874413262823680:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787580166.731044:0:14390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787580166.731059:0:14390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fae48db9600/0xc86deac2083387be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc86deac2083387b7 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580166.731090:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fae48db9600/0xc86deac2083387be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc86deac2083387b7 expref: 10 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580166.731117:0:14390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fae48db9600/0xc86deac2083387be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac2083387b7 expref: 10 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580166.731127:0:14390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae48db9600, rc 0) 00000100:00100000:2.0:1787580166.731157:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d515850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5949e638-96f6-489a-aea1-b9b80ed3224f+10:14377:x1874413262823680:12345-0@lo:101:mount.lustre.0 Request processed in 124us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580166.731164:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787580166.731658:0:14377:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7e97f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:14377:1874413262823680:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787580166.731673:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff8fae50feb200/0xc86deac2083387b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac2083387be expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580166.731682:0:14377:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff8fae50feb200/0xc86deac2083387b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc86deac2083387be expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580166.732348:0:14377:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7e97f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:14377:1874413262823808:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1787580166.732728:0:14377:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580166.732799:0:14377:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae50f2ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787580166.736820:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262823808 00000100:00100000:2.0:1787580166.736837:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262823808 00000100:00100000:3.0:1787580166.737022:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787580166.737034:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d517c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5949e638-96f6-489a-aea1-b9b80ed3224f+10:14377:x1874413262823808:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1787580166.737061:0:14390:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1787580166.737081:0:14390:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1787580166.737369:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d517c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5949e638-96f6-489a-aea1-b9b80ed3224f+10:14377:x1874413262823808:12345-0@lo:256:mount.lustre.0 Request processed in 336us (4640us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580166.737377:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787580166.737525:0:14377:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7e97f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:14377:1874413262823808:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1787580166.738161:0:14377:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787580166.738186:0:14377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae50feb200/0xc86deac2083387b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac2083387be expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580166.738198:0:14377:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff8fae50feb200/0xc86deac2083387b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac2083387be expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787580166.738270:0:14377:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8fae50b5d800 from 1 10000000:01000000:0.0:1787580166.738273:0:14377:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787580166.738307:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae50feb400/0xc86deac2083387c5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580166.738315:0:14377:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff8fae50feb400/0xc86deac2083387c5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580166.738323:0:14377:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff8fae50feb400/0xc86deac2083387c5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580166.738342:0:14377:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7e97f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:14377:1874413262823936:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787580166.738429:0:14377:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580166.739954:0:14377:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae50f2ecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787580166.743346:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262823936 00000100:00100000:3.0:1787580166.743362:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262823936 00000100:00100000:3.0:1787580166.743429:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787580166.743441:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d515450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5949e638-96f6-489a-aea1-b9b80ed3224f+10:14377:x1874413262823936:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787580166.743461:0:14390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787580166.743491:0:14390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fae5f6d6200/0xc86deac2083387cc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc86deac2083387c5 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580166.743524:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fae5f6d6200/0xc86deac2083387cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc86deac2083387c5 expref: 11 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580166.743535:0:14390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fae5f6d6200/0xc86deac2083387cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac2083387c5 expref: 11 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580166.743545:0:14390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae5f6d6200, rc 0) 00000100:00100000:3.0:1787580166.743657:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d515450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5949e638-96f6-489a-aea1-b9b80ed3224f+11:14377:x1874413262823936:12345-0@lo:101:mount.lustre.0 Request processed in 219us (5227us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580166.743664:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787580166.743978:0:14377:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7e97f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:14377:1874413262823936:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787580166.743999:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff8fae50feb400/0xc86deac2083387c5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac2083387cc expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580166.744010:0:14377:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff8fae50feb400/0xc86deac2083387c5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc86deac2083387cc expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580166.744097:0:14377:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7e97f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:14377:1874413262824064:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787580166.744141:0:14377:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580166.744176:0:14377:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae50f2ecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787580166.744296:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262824064 00000100:00100000:3.0:1787580166.744301:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262824064 00000100:00100000:3.0:1787580166.744320:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787580166.744326:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d514450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5949e638-96f6-489a-aea1-b9b80ed3224f+11:14377:x1874413262824064:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787580166.745063:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d514450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5949e638-96f6-489a-aea1-b9b80ed3224f+11:14377:x1874413262824064:12345-0@lo:501:mount.lustre.0 Request processed in 733us (918us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580166.745149:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787580166.745332:0:14377:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7e97f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:14377:1874413262824064:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787580166.745371:0:14377:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7e97f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:14377:1874413262824192:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787580166.745466:0:14377:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580166.745490:0:14377:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae50f2ecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787580166.746183:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262824192 00000100:00100000:3.0:1787580166.746191:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262824192 00000100:00100000:3.0:1787580166.746237:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787580166.746245:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d514050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5949e638-96f6-489a-aea1-b9b80ed3224f+11:14377:x1874413262824192:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787580166.746463:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d514050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5949e638-96f6-489a-aea1-b9b80ed3224f+11:14377:x1874413262824192:12345-0@lo:503:mount.lustre.0 Request processed in 218us (996us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580166.746471:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787580166.749872:0:14377:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7e97f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:14377:1874413262824192:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787580166.750453:0:14421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae507ba300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5949e638-96f6-489a-aea1-b9b80ed3224f:14421:1874413262824320:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787580166.750531:0:14421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580166.750585:0:14421:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae49ef0300 going to sleep for 11 seconds 00000100:00100000:0.0:1787580166.750743:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262824320 00000100:00100000:0.0:1787580166.750750:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262824320 00000100:00100000:0.0:1787580166.750792:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787580166.750802:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5949e638-96f6-489a-aea1-b9b80ed3224f+11:14421:x1874413262824320:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787580166.751093:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5949e638-96f6-489a-aea1-b9b80ed3224f+11:14421:x1874413262824320:12345-0@lo:502:llog_process_th.0 Request processed in 291us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580166.751102:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787580166.751435:0:14421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae507ba300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5949e638-96f6-489a-aea1-b9b80ed3224f:14421:1874413262824320:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787580166.751465:0:14421:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787580166.751475:0:14421:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787580166.751477:0:14421:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787580166.751485:0:14421:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8fae50b5d800 00000020:00000080:3.0:1787580166.751488:0:14421:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787580166.751496:0:14421:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787580166.751504:0:14421:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787580166.751506:0:14421:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787580166.751509:0:14421:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787580166.751511:0:14421:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787580166.751512:0:14421:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787580166.751516:0:14421:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8fae50b5d800 00000020:00000080:3.0:1787580166.751518:0:14421:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787580166.751770:0:14421:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787580166.751776:0:14421:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787580166.751777:0:14421:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787580166.751780:0:14421:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787580166.751782:0:14421:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787580166.751783:0:14421:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787580166.751786:0:14421:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8fae50b5d800 00000020:00000080:3.0:1787580166.751788:0:14421:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787580166.751828:0:14421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae507ba300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5949e638-96f6-489a-aea1-b9b80ed3224f:14421:1874413262824448:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787580166.751868:0:14421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580166.751902:0:14421:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae49ef0300 going to sleep for 11 seconds 00000100:00100000:1.0:1787580166.751954:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262824448 00000100:00100000:1.0:1787580166.751959:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262824448 00000100:00100000:1.0:1787580166.751995:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787580166.752009:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5949e638-96f6-489a-aea1-b9b80ed3224f+11:14421:x1874413262824448:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787580166.752193:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5949e638-96f6-489a-aea1-b9b80ed3224f+11:14421:x1874413262824448:12345-0@lo:502:llog_process_th.0 Request processed in 184us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580166.752199:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787580166.758478:0:14421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae507ba300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5949e638-96f6-489a-aea1-b9b80ed3224f:14421:1874413262824448:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787580166.758524:0:14421:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787580166.758532:0:14421:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787580166.758534:0:14421:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787580166.758540:0:14421:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1787580166.760988:0:14377:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1787580166.761023:0:14377:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787580166.761143:0:14377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae50feb400/0xc86deac2083387c5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac2083387cc expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580166.761157:0:14377:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff8fae50feb400/0xc86deac2083387c5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac2083387cc expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787580166.761201:0:14377:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787580166.761204:0:14377:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8fae50b5d800 10000000:01000000:0.0:1787580166.761207:0:14377:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8fae50b5d800 10000000:01000000:0.0:1787580166.761211:0:14377:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787580166.761217:0:14377:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8fae50b5d800 from 1 10000000:01000000:0.0:1787580166.761219:0:14377:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787580166.761255:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae50fea600/0xc86deac2083387d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580166.761263:0:14377:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff8fae50fea600/0xc86deac2083387d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580166.761284:0:14377:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff8fae50fea600/0xc86deac2083387d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580166.761308:0:14377:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7e97f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:14377:1874413262824576:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787580166.761375:0:14377:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580166.761499:0:14377:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae5f8adcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787580166.774585:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262824576 00000100:00100000:2.0:1787580166.774601:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262824576 00000100:00100000:2.0:1787580166.774667:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787580166.774679:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5949e638-96f6-489a-aea1-b9b80ed3224f+11:14377:x1874413262824576:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787580166.774700:0:14389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787580166.774722:0:14389:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fae48db8c00/0xc86deac2083387da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc86deac2083387d3 expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580166.774753:0:14389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fae48db8c00/0xc86deac2083387da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc86deac2083387d3 expref: 12 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580166.774764:0:14389:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fae48db8c00/0xc86deac2083387da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac2083387d3 expref: 12 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580166.774774:0:14389:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae48db8c00, rc 0) 00000100:00100000:2.0:1787580166.774864:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5949e638-96f6-489a-aea1-b9b80ed3224f+12:14377:x1874413262824576:12345-0@lo:101:mount.lustre.0 Request processed in 188us (13488us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580166.774872:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787580166.775240:0:14377:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7e97f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:14377:1874413262824576:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787580166.775260:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff8fae50fea600/0xc86deac2083387d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac2083387da expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580166.775271:0:14377:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff8fae50fea600/0xc86deac2083387d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc86deac2083387da expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580166.775347:0:14377:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7e97f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:14377:1874413262824704:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787580166.775410:0:14377:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580166.776843:0:14377:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae5f8adcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787580166.778191:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262824704 00000100:00100000:1.0:1787580166.778202:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262824704 00000100:00100000:1.0:1787580166.778261:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787580166.778272:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5949e638-96f6-489a-aea1-b9b80ed3224f+12:14377:x1874413262824704:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787580166.785804:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5949e638-96f6-489a-aea1-b9b80ed3224f+12:14377:x1874413262824704:12345-0@lo:501:mount.lustre.0 Request processed in 7523us (10410us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580166.785822:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787580166.785919:0:14377:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7e97f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:14377:1874413262824704:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787580166.785982:0:14377:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5072a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:14377:1874413262824832:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787580166.786041:0:14377:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787580166.786217:0:14377:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae45eedc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787580166.786990:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262824832 00000100:00100000:3.0:1787580166.786999:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262824832 00000100:00100000:3.0:1787580166.787050:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787580166.787059:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5949e638-96f6-489a-aea1-b9b80ed3224f+12:14377:x1874413262824832:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787580166.787313:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5949e638-96f6-489a-aea1-b9b80ed3224f+12:14377:x1874413262824832:12345-0@lo:503:mount.lustre.0 Request processed in 252us (1269us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580166.787321:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787580166.789435:0:14377:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5072a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:14377:1874413262824832:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787580166.791867:0:14426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae507ba300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5949e638-96f6-489a-aea1-b9b80ed3224f:14426:1874413262824960:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787580166.791953:0:14426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580166.791989:0:14426:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae49ef0240 going to sleep for 11 seconds 00000100:00100000:1.0:1787580166.792642:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262824960 00000100:00100000:1.0:1787580166.792652:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262824960 00000100:00100000:1.0:1787580166.792706:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787580166.792716:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5949e638-96f6-489a-aea1-b9b80ed3224f+12:14426:x1874413262824960:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787580166.792988:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5949e638-96f6-489a-aea1-b9b80ed3224f+12:14426:x1874413262824960:12345-0@lo:502:llog_process_th.0 Request processed in 272us (1035us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580166.792996:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787580166.794585:0:14426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae507ba300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5949e638-96f6-489a-aea1-b9b80ed3224f:14426:1874413262824960:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1787580166.794670:0:14426:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1787580166.794686:0:14426:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8fae6d543370) 00000020:00000080:3.0:1787580166.794707:0:14426:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:3.0:1787580166.794803:0:14426:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8fae50b5d800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787580166.794807:0:14426:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8fae50b5d800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787580166.794810:0:14426:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8fae50b5d800 4 00010000:00080000:3.0:1787580166.794838:0:14426:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8fae48c72800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.136@tcp at head 00010000:00010000:3.0:1787580166.800761:0:14426:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:3.0:1787580166.800969:0:14426:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1787580166.801007:0:14426:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787580166.801020:0:14426:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xc86deac2083387e8 00000100:00080000:3.0:1787580166.801030:0:14426:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787580166.801036:0:14426:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8fae48c72800 using connection 192.168.202.136@tcp/0@lo 00000100:00100000:3.0:1787580166.801072:0:14426:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fae507ba300 x1874413262825088/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787580166.801127:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae507ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874413262825088:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787580166.801203:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787580166.801268:0:14426:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787580166.801832:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262825088 00000100:00100000:0.0:1787580166.801841:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262825088 00000100:00100000:0.0:1787580166.801871:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787580166.801880:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae507b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3313:x1874413262825088:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787580166.801942:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae507b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3313:x1874413262825088:12345-0@lo:38:llog_process_th.0 Request processed in 62us (738us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787580166.801950:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787580166.801986:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787580166.801994:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8fae48c72800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787580166.801998:0:3313:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787580166.802009:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae507ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874413262825088:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787580166.809970:0:14426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae507bb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5949e638-96f6-489a-aea1-b9b80ed3224f:14426:1874413262825216:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787580166.810064:0:14426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580166.810127:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262825216 00000100:00100000:3.0:1787580166.810139:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262825216 00000100:00100000:3.0:1787580166.810206:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787580166.810215:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5949e638-96f6-489a-aea1-b9b80ed3224f+12:14426:x1874413262825216:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787580166.810551:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5949e638-96f6-489a-aea1-b9b80ed3224f+12:14426:x1874413262825216:12345-0@lo:502:llog_process_th.0 Request processed in 336us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580166.810560:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787580166.811736:0:14426:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae49ef0240 going to sleep for 11 seconds 00000100:00100000:3.0:1787580166.811767:0:14426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae507bb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5949e638-96f6-489a-aea1-b9b80ed3224f:14426:1874413262825216:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1787580166.811804:0:14426:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1787580166.811987:0:14377:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1787580166.812009:0:14377:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787580166.812035:0:14377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae50fea600/0xc86deac2083387d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac2083387da expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580166.812046:0:14377:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff8fae50fea600/0xc86deac2083387d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac2083387da expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787580166.812091:0:14377:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787580166.812093:0:14377:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787580166.812095:0:14377:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787580166.812096:0:14377:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787580166.812098:0:14377:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787580166.812099:0:14377:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787580166.812100:0:14377:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787580166.812102:0:14377:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787580166.812114:0:14377:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787580166.812115:0:14377:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787580166.812119:0:14377:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1787580166.812121:0:14377:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787580166.812122:0:14377:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787580166.812123:0:14377:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787580166.812125:0:14377:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787580166.812126:0:14377:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787580166.812127:0:14377:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787580166.812128:0:14377:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787580166.812129:0:14377:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787580166.812130:0:14377:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787580166.812131:0:14377:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787580166.812151:0:14377:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787580166.812167:0:14377:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5072a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:14377:1874413262825344:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787580166.812213:0:14377:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787580166.812235:0:14377:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae47eecb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787580166.813970:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262825344 00000100:00100000:3.0:1787580166.813981:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262825344 00000100:00100000:3.0:1787580166.814039:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787580166.814048:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5949e638-96f6-489a-aea1-b9b80ed3224f+12:14377:x1874413262825344:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787580166.814078:0:14388:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787580166.814091:0:14388:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787580166.891056:0:14388:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787580166.891117:0:14388:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1787580166.900144:0:14411:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787580166.900153:0:14411:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787580166.900593:0:14411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8fae50febc00/0xc86deac2083387ef lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580166.900615:0:14411:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fae48db9600/0xc86deac2083387be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac2083387b7 expref: 12 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580166.900623:0:14411:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8fae50febc00/0xc86deac2083387ef lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580166.900673:0:14411:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fae48db9600/0xc86deac2083387be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc86deac2083387b7 expref: 12 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580166.900688:0:14411:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8fae48db9600/0xc86deac2083387be lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc86deac2083387b7 expref: 12 pid: 14390 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580166.900703:0:14411:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7e97df80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14411:1874413262825472:0@lo:104: 00000100:00100000:0.0:1787580166.900866:0:14411:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580166.900913:0:14411:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae5f8ada80 going to sleep for 11 seconds 00000100:00100000:1.0:1787580166.901625:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262825472 00000100:00100000:1.0:1787580166.901636:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262825472 00000100:00100000:1.0:1787580166.901690:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787580166.901707:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7e97d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5949e638-96f6-489a-aea1-b9b80ed3224f+3:14411:x1874413262825472:12345-0@lo:104: 00010000:00010000:1.0:1787580166.901720:0:14378:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.136@tcp lock: ffff8fae50feb200/0xc86deac2083387b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc86deac2083387be expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580166.901791:0:14378:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787580166.901798:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7e97d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5949e638-96f6-489a-aea1-b9b80ed3224f+3:14411:x1874413262825472:12345-0@lo:104: Request processed in 94us (933us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580166.901806:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787580166.902143:0:14411:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7e97df80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14411:1874413262825472:0@lo:104: 00010000:00010000:0.0:1787580166.902163:0:14411:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8fae50febc00/0xc86deac2083387ef lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580166.902898:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787580166.902908:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.136@tcp lock: ffff8fae50feb200/0xc86deac2083387b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc86deac2083387be expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580166.902918:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae50feb200 already unused, calling callback (ffffffffc1b77c20) 10000000:00010000:3.0:1787580166.902923:0:14384:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.136@tcp lock: ffff8fae50feb200/0xc86deac2083387b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc86deac2083387be expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580166.903144:0:14384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: ffff8fae50feb200/0xc86deac2083387b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc86deac2083387be expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787580166.903152:0:14384:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: ffff8fae50feb200/0xc86deac2083387b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc86deac2083387be expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787580166.903168:0:14384:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787580166.903222:0:14384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.136@tcp lock: ffff8fae50feb200/0xc86deac2083387b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac2083387be expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580166.903229:0:14384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787580166.903259:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.136@tcp lock: ffff8fae50feb200/0xc86deac2083387b7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac2083387be expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580166.903266:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: ffff8fae50feb200/0xc86deac2083387b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac2083387be expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580166.903285:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787580166.903287:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787580166.903288:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787580166.903848:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787580166.903865:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae507bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5949e638-96f6-489a-aea1-b9b80ed3224f:3316:1874413262825600:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787580166.905432:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580166.906000:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262825600 00000100:00100000:3.0:1787580166.906010:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262825600 00010000:00010000:3.0:1787580166.906059:0:14380:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fae48db9600/0xc86deac2083387be lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc86deac2083387b7 expref: 13 pid: 14390 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580166.906091:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787580166.906101:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7e97df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5949e638-96f6-489a-aea1-b9b80ed3224f+13:3316:x1874413262825600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787580166.906125:0:14380:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787580166.906131:0:14380:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fae48db9600/0xc86deac2083387be lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc86deac2083387b7 expref: 13 pid: 14390 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580166.906143:0:14380:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fae48db9600/0xc86deac2083387be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc86deac2083387b7 expref: 13 pid: 14390 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580166.906161:0:14380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fae48db9600/0xc86deac2083387be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc86deac2083387b7 expref: 13 pid: 14390 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580166.906191:0:14380:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8fae50febc00/0xc86deac2083387ef lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580166.906198:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fae50febc00/0xc86deac2083387ef lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787580166.906213:0:14380:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006060868s 00010000:00010000:3.0:1787580166.906218:0:14380:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fae50febc00/0xc86deac2083387ef lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580166.906225:0:14380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fae50febc00/0xc86deac2083387ef lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580166.906232:0:14380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8fae50febc00/0xc86deac2083387ef lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580166.906239:0:14380:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8fae50febc00/0xc86deac2083387ef lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580166.906245:0:14380:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae50febc00 already unused, calling callback (ffffffffc155a230) 00010000:00010000:3.0:1787580166.906251:0:14380:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8fae50febc00/0xc86deac2083387ef lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580166.906259:0:14380:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8fae50febc00/0xc86deac2083387ef lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580166.906272:0:14380:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8fae50febc00/0xc86deac2083387ef lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580166.906283:0:14380:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787580166.906338:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7e97df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5949e638-96f6-489a-aea1-b9b80ed3224f+12:3316:x1874413262825600:12345-0@lo:103:ldlm_bl.0 Request processed in 238us (910us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580166.906345:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787580166.907293:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae507bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5949e638-96f6-489a-aea1-b9b80ed3224f:3316:1874413262825600:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787580166.907325:0:14411:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8fae50febc00/0xc86deac2083387ef lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580166.907347:0:14411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8fae50febc00/0xc86deac2083387ef lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580166.907353:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fae50febc00/0xc86deac2083387ef lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580166.929378:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5949e638-96f6-489a-aea1-b9b80ed3224f+11:14377:x1874413262825344:12345-0@lo:253:mount.lustre.0 Request processed in 115317us (117150us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580166.929429:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787580166.929613:0:14377:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5072a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:14377:1874413262825344:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787580166.929630:0:14377:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787580166.929633:0:14377:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787580166.929635:0:14377:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787580166.929636:0:14377:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787580166.929637:0:14377:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787580166.929638:0:14377:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787580166.929640:0:14377:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787580166.929641:0:14377:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787580166.929643:0:14377:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787580166.929645:0:14377:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787580166.929647:0:14377:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787580166.929661:0:14377:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1787580166.935899:0:14377:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1787580166.936211:0:14377:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1787580166.936897:0:14377:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1787580166.937791:0:14377:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1787580166.938844:0:14377:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1787580166.947241:0:14377:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1787580166.951251:0:14377:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1787580166.951458:0:14377:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1787580166.952062:0:14377:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1787580166.952327:0:14377:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1787580166.953068:0:14377:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1787580166.953233:0:14377:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:2.0:1787580167.021327:0:14377:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000020:00080000:2.0:1787580167.023161:0:14433:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:2.0:1787580167.023167:0:14433:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:0.0:1787580167.023214:0:14377:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:2.0:1787580167.023736:0:14434:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:2.0:1787580167.023847:0:14434:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787580167.026130:0:14434:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787580167.026228:0:14434:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1787580167.026232:0:14434:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:1.0:1787580167.036625:0:14377:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1787580167.036784:0:14377:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1787580167.037217:0:14377:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1787580167.037224:0:14377:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1787580167.037351:0:14377:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787580167.041426:0:14377:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1787580167.042019:0:14377:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1787580167.042049:0:14377:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:1.0:1787580167.043411:0:14377:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:1.0:1787580167.053992:0:14377:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1787580167.103333:0:14377:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1787580167.103408:0:14377:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa15781cfb988 00100000:10000000:1.0:1787580167.103417:0:14377:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1787580167.104282:0:14377:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787580167.104301:0:14377:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.136@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787580167.104318:0:14377:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1787580167.104335:0:14377:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:3.0:1787580167.411646:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787580167.860026:0:14427:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:3.0:1787580168.187864:0:14393:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787580168.187871:0:14393:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8fae50b5d800 from 6 10000000:01000000:3.0:1787580168.187876:0:14393:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787580168.187924:0:14393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae5f6d7000/0xc86deac2083387f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580168.187936:0:14393:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff8fae5f6d7000/0xc86deac2083387f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580168.187949:0:14393:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff8fae5f6d7000/0xc86deac2083387f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580168.187977:0:14393:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae507bb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5949e638-96f6-489a-aea1-b9b80ed3224f:14393:1874413262825728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787580168.188049:0:14393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580168.188111:0:14393:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae50970c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787580168.188433:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262825728 00000100:00100000:2.0:1787580168.188441:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262825728 00000100:00100000:2.0:1787580168.188495:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787580168.188505:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5949e638-96f6-489a-aea1-b9b80ed3224f+11:14393:x1874413262825728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787580168.188518:0:14389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787580168.188532:0:14389:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fae48db8000/0xc86deac2083387fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc86deac2083387f6 expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580168.188555:0:14389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fae48db8000/0xc86deac2083387fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc86deac2083387f6 expref: 12 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580168.188566:0:14389:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fae48db8000/0xc86deac2083387fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac2083387f6 expref: 12 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580168.188575:0:14389:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae48db8000, rc 0) 00000100:00100000:2.0:1787580168.188616:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5949e638-96f6-489a-aea1-b9b80ed3224f+12:14393:x1874413262825728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580168.188622:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787580168.188780:0:14393:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae507bb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5949e638-96f6-489a-aea1-b9b80ed3224f:14393:1874413262825728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787580168.188796:0:14393:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff8fae5f6d7000/0xc86deac2083387f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac2083387fd expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580168.188805:0:14393:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff8fae5f6d7000/0xc86deac2083387f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc86deac2083387fd expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580168.188858:0:14393:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae507bb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5949e638-96f6-489a-aea1-b9b80ed3224f:14393:1874413262825856:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787580168.188889:0:14393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580168.188921:0:14393:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae50970c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787580168.188999:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262825856 00000100:00100000:1.0:1787580168.189004:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262825856 00000100:00100000:1.0:1787580168.189026:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787580168.189033:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5949e638-96f6-489a-aea1-b9b80ed3224f+12:14393:x1874413262825856:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787580168.189047:0:14390:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787580168.189061:0:14390:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787580168.189064:0:14390:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1787580168.189157:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5949e638-96f6-489a-aea1-b9b80ed3224f+12:14393:x1874413262825856:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 124us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580168.189164:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787580168.189194:0:14393:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae507bb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5949e638-96f6-489a-aea1-b9b80ed3224f:14393:1874413262825856:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787580168.189234:0:14393:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787580168.189241:0:14393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae5f6d7000/0xc86deac2083387f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac2083387fd expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580168.189249:0:14393:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff8fae5f6d7000/0xc86deac2083387f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac2083387fd expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580168.435935:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787580168.884187:0:14427:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787580169.460051:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787580170.484587:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787580171.516992:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787580171.902161:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787580171.902169:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787580171.902171:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787580171.902174:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787580171.902177:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787580171.902180:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787580171.902184:0:37:0:(import.c:65:import_set_state_nolock()) ffff8fae48c72800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787580171.902197:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8fae48c72800 using connection 192.168.202.136@tcp/0@lo 00000100:00100000:1.0:1787580171.902218:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fae50728700 x1874413262826112/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787580171.902316:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5072a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5949e638-96f6-489a-aea1-b9b80ed3224f:3314:1874413262825984:0@lo:400:kworker.0 00000100:00100000:0.0:1787580171.902429:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580171.902505:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae50728700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874413262826112:0@lo:38:kworker.0 00000100:00100000:0.0:1787580171.902534:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580171.902574:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262826112 00000100:00100000:0.0:1787580171.902581:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262826112 00000100:00100000:0.0:1787580171.902611:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787580171.902618:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7e97d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3313:x1874413262826112:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1787580171.902644:0:14397:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 519 last 0 00000020:00000080:0.0:1787580171.902696:0:14397:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xc86deac208338804 00000004:00100000:0.0:1787580171.902710:0:14397:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787580171.902847:0:14397:0:(import.c:65:import_set_state_nolock()) ffff8fae47223800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787580171.902916:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7e97d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874413262826112:12345-0@lo:38:kworker.0 Request processed in 296us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580171.902924:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787580171.902971:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8fae50728700 x1874413262826112/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787580181 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787580171.903210:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262825984 00000100:00100000:1.0:1787580171.903215:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262825984 00000100:00100000:1.0:1787580171.903255:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787580171.903262:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5949e638-96f6-489a-aea1-b9b80ed3224f+12:3314:x1874413262825984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787580171.903301:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5949e638-96f6-489a-aea1-b9b80ed3224f+12:3314:x1874413262825984:12345-0@lo:400:kworker.0 Request processed in 39us (872us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580171.903306:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787580171.903599:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5072a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5949e638-96f6-489a-aea1-b9b80ed3224f:3314:1874413262825984:0@lo:400:kworker.0 00000100:00080000:0.0:1787580171.903656:0:3313:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1787580171.903666:0:3313:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1787580171.903671:0:3313:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787580171.903674:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8fae48c72800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787580171.903680:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae50728700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874413262826112:0@lo:38:kworker.0 00010000:00010000:0.0:1787580172.531634:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787580173.412165:0:14677:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg236-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787580173.557263:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787580174.579630:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787580175.605579:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787580176.495082:0:14827:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe0f9abd10 20000000:00000080:3.0:1787580176.495103:0:14827:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8fae50fabc00 uarg=0000000000000000 20000000:01000000:3.0:1787580176.495205:0:14827:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1787580176.495212:0:14827:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1787580176.495218:0:14827:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1787580176.514418:0:14828:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:3.0:1787580176.514549:0:14827:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1787580176.526157:0:14827:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787580176.526191:0:14827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8fae5f6d6000/0xc86deac20833880b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580176.526212:0:14827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fae5f6d6200/0xc86deac2083387cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac2083387c5 expref: 11 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580176.526221:0:14827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8fae5f6d6000/0xc86deac20833880b lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580176.526265:0:14827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fae5f6d6200/0xc86deac2083387cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc86deac2083387c5 expref: 11 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580176.526281:0:14827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8fae5f6d6200/0xc86deac2083387cc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc86deac2083387c5 expref: 11 pid: 14390 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580176.526298:0:14827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae507bad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14827:1874413262826240:0@lo:104: 00000100:00100000:3.0:1787580176.527269:0:14827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580176.527409:0:14827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae50970840 going to sleep for 11 seconds 00000100:00100000:1.0:1787580176.537570:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262826240 00000100:00100000:1.0:1787580176.537586:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262826240 00000100:00100000:1.0:1787580176.537646:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787580176.537655:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae507b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5949e638-96f6-489a-aea1-b9b80ed3224f+3:14827:x1874413262826240:12345-0@lo:104: 00010000:00010000:1.0:1787580176.537674:0:14379:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.136@tcp lock: ffff8fae50feb400/0xc86deac2083387c5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc86deac2083387cc expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580176.538065:0:14379:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787580176.538073:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae507b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5949e638-96f6-489a-aea1-b9b80ed3224f+3:14827:x1874413262826240:12345-0@lo:104: Request processed in 419us (10806us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580176.538080:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1787580176.538721:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787580176.538731:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.136@tcp lock: ffff8fae50feb400/0xc86deac2083387c5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc86deac2083387cc expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580176.538740:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae50feb400 already unused, calling callback (ffffffffc1b77c20) 10000000:00010000:0.0:1787580176.538745:0:14384:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.136@tcp lock: ffff8fae50feb400/0xc86deac2083387c5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc86deac2083387cc expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580176.538755:0:14384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: ffff8fae50feb400/0xc86deac2083387c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc86deac2083387cc expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787580176.538762:0:14384:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: ffff8fae50feb400/0xc86deac2083387c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc86deac2083387cc expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787580176.538777:0:14384:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787580176.538823:0:14384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.136@tcp lock: ffff8fae50feb400/0xc86deac2083387c5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac2083387cc expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580176.538830:0:14384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787580176.538873:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.136@tcp lock: ffff8fae50feb400/0xc86deac2083387c5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac2083387cc expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580176.538881:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: ffff8fae50feb400/0xc86deac2083387c5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac2083387cc expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580176.538905:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787580176.538908:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787580176.538909:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787580176.538918:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787580176.539273:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7e97ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5949e638-96f6-489a-aea1-b9b80ed3224f:3314:1874413262826368:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787580176.539329:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787580176.539470:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262826368 00000100:00100000:2.0:1787580176.539484:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262826368 00010000:00010000:2.0:1787580176.539514:0:14380:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fae5f6d6200/0xc86deac2083387cc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc86deac2083387c5 expref: 12 pid: 14390 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580176.539539:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787580176.539548:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7e97d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5949e638-96f6-489a-aea1-b9b80ed3224f+12:3314:x1874413262826368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787580176.539560:0:14380:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787580176.539564:0:14380:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fae5f6d6200/0xc86deac2083387cc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc86deac2083387c5 expref: 12 pid: 14390 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580176.539575:0:14380:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fae5f6d6200/0xc86deac2083387cc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc86deac2083387c5 expref: 12 pid: 14390 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580176.539593:0:14380:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8fae5f6d6000/0xc86deac20833880b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580176.539601:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fae5f6d6000/0xc86deac20833880b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580176.539616:0:14380:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fae5f6d6000/0xc86deac20833880b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580176.539623:0:14380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fae5f6d6000/0xc86deac20833880b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580176.539630:0:14380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8fae5f6d6000/0xc86deac20833880b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580176.539636:0:14380:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8fae5f6d6000/0xc86deac20833880b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580176.539640:0:14380:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae5f6d6000 already unused, calling callback (ffffffffc155a230) 00010000:00010000:2.0:1787580176.539650:0:14380:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8fae5f6d6000/0xc86deac20833880b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580176.539657:0:14380:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8fae5f6d6000/0xc86deac20833880b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580176.539668:0:14380:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8fae5f6d6000/0xc86deac20833880b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580176.539678:0:14380:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787580176.539722:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7e97d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5949e638-96f6-489a-aea1-b9b80ed3224f+12:3314:x1874413262826368:12345-0@lo:103:ldlm_bl.0 Request processed in 174us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580176.539730:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787580176.539805:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7e97ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5949e638-96f6-489a-aea1-b9b80ed3224f:3314:1874413262826368:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787580176.540540:0:14827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fae5f6d6200/0xc86deac2083387cc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc86deac2083387c5 expref: 11 pid: 14390 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580176.540554:0:14827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae507bad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14827:1874413262826240:0@lo:104: 00010000:00010000:3.0:1787580176.540571:0:14827:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8fae5f6d6000/0xc86deac20833880b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580176.540601:0:14827:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8fae5f6d6000/0xc86deac20833880b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580176.540607:0:14827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8fae5f6d6000/0xc86deac20833880b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580176.540612:0:14827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fae5f6d6000/0xc86deac20833880b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580176.630640:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787580177.011491:0:3313:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787580166/real 1787580166] req@ffff8fae5072aa00 x1874413262823424/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787580176 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787580177.011525:0:3313:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8fae5072aa00 x1874413262823424/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787580176 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787580177.011537:0:3313:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787580166/real 1787580166] req@ffff8fae6d5baa00 x1874413262823296/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787580176 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787580177.011548:0:3313:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8fae6d5baa00 x1874413262823296/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787580176 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787580177.011566:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8fae7f61c000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787580177.011574:0:3313:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787580177.011578:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5072aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1874413262823424:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1787580177.011583:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8fae6a23d000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787580177.011587:0:3313:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787580177.011590:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d5baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1874413262823296:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1787580177.011739:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787580177.011745:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787580177.011748:0:37:0:(import.c:65:import_set_state_nolock()) ffff8fae6a23d000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787580177.011753:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 514 00000100:00080000:3.0:1787580177.011758:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787580177.011765:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8fae6a23d000 using connection 192.168.202.136@tcp/0@lo 00000100:00100000:3.0:1787580177.011799:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fae507bad80 x1874413262826496/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787580177.011822:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787580177.011826:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787580177.011828:0:37:0:(import.c:65:import_set_state_nolock()) ffff8fae7f61c000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787580177.011831:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 514 00000100:00080000:3.0:1787580177.011841:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787580177.011845:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8fae7f61c000 using connection 192.168.202.136@tcp/0@lo 00000100:00100000:3.0:1787580177.011859:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fae507baa00 x1874413262826624/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787580177.011943:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787580177.011956:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae507b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874413262826752:0@lo:400:kworker.0 00000100:00100000:1.0:1787580177.012034:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787580177.012113:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae507bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1874413262826496:0@lo:8:kworker.0 00000400:00000100:1.0:1787580177.012148:0:3313:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874413262826496 offset 0 length 520: 4 00000100:00100000:1.0:1787580177.012169:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae507baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1874413262826624:0@lo:8:kworker.0 00000400:00000100:1.0:1787580177.012187:0:3313:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874413262826624 offset 0 length 520: 4 00000100:00100000:3.0:1787580177.012316:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262826752 00000100:00100000:3.0:1787580177.012324:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262826752 00000100:00100000:3.0:1787580177.012411:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787580177.012421:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5072aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874413262826752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787580177.012477:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5072aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874413262826752:12345-0@lo:400:kworker.0 Request processed in 57us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580177.012483:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787580177.012519:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8fae507b9f80 x1874413262826752/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787580193 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787580177.012531:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae507b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874413262826752:0@lo:400:kworker.0 00010000:00010000:3.0:1787580177.656940:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787580177.908462:0:14393:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787580177.908473:0:14393:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8fae50b5d800 from 10 10000000:01000000:1.0:1787580177.908480:0:14393:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787580177.908545:0:14393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae4ca59800/0xc86deac208338812 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580177.908558:0:14393:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff8fae4ca59800/0xc86deac208338812 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580177.908570:0:14393:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff8fae4ca59800/0xc86deac208338812 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580177.908600:0:14393:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5072a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5949e638-96f6-489a-aea1-b9b80ed3224f:14393:1874413262826880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787580177.908677:0:14393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787580177.908735:0:14393:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae437149c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787580177.910225:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262826880 00000100:00100000:2.0:1787580177.910239:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262826880 00000100:00100000:2.0:1787580177.910309:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787580177.910321:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5949e638-96f6-489a-aea1-b9b80ed3224f+11:14393:x1874413262826880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787580177.910339:0:14388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787580177.910359:0:14388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fae48db8200/0xc86deac208338819 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc86deac208338812 expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580177.910407:0:14388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fae48db8200/0xc86deac208338819 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc86deac208338812 expref: 12 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580177.910420:0:14388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fae48db8200/0xc86deac208338819 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac208338812 expref: 12 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580177.910430:0:14388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae48db8200, rc 0) 00000100:00100000:2.0:1787580177.910509:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5949e638-96f6-489a-aea1-b9b80ed3224f+12:14393:x1874413262826880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 189us (1832us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580177.910534:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787580177.910593:0:14393:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5072a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5949e638-96f6-489a-aea1-b9b80ed3224f:14393:1874413262826880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787580177.910612:0:14393:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff8fae4ca59800/0xc86deac208338812 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208338819 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580177.910621:0:14393:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff8fae4ca59800/0xc86deac208338812 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc86deac208338819 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580177.910694:0:14393:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d5baa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5949e638-96f6-489a-aea1-b9b80ed3224f:14393:1874413262827008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787580177.910725:0:14393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787580177.910756:0:14393:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fad418ef3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787580177.910770:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262827008 00000100:00100000:2.0:1787580177.910774:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262827008 00000100:00100000:2.0:1787580177.910797:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787580177.910804:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5949e638-96f6-489a-aea1-b9b80ed3224f+12:14393:x1874413262827008:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787580177.911089:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5949e638-96f6-489a-aea1-b9b80ed3224f+12:14393:x1874413262827008:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 285us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580177.911096:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787580177.911127:0:14393:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d5baa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5949e638-96f6-489a-aea1-b9b80ed3224f:14393:1874413262827008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787580177.911154:0:14393:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d5baa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5949e638-96f6-489a-aea1-b9b80ed3224f:14393:1874413262827136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787580177.911190:0:14393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787580177.911203:0:14393:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fad418ef3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787580177.911215:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262827136 00000100:00100000:2.0:1787580177.911218:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262827136 00000100:00100000:2.0:1787580177.911238:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787580177.911250:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6e8a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5949e638-96f6-489a-aea1-b9b80ed3224f+12:14393:x1874413262827136:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787580177.911420:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6e8a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5949e638-96f6-489a-aea1-b9b80ed3224f+12:14393:x1874413262827136:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 170us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580177.911427:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787580177.911466:0:14393:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d5baa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5949e638-96f6-489a-aea1-b9b80ed3224f:14393:1874413262827136:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787580177.920306:0:14887:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1787580177.927625:0:14393:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1787580177.927666:0:14393:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787580177.927680:0:14393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae4ca59800/0xc86deac208338812 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208338819 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580177.927693:0:14393:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff8fae4ca59800/0xc86deac208338812 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208338819 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787580178.100197:0:14427:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787580178.676633:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787580179.703277:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787580180.723581:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787580181.747552:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787580182.055904:0:15077:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787580182.055908:0:15077:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1787580182.056031:0:15077:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8fae51c01000 00000020:01000004:2.0:1787580182.056048:0:15077:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1787580182.056062:0:15077:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1787580182.056079:0:15077:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8fae7e9db370) 00000020:00000080:2.0:1787580182.056099:0:15077:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787580182.077855:0:15077:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787580182.084711:0:15077:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1787580182.087667:0:15077:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787580182.087932:0:15077:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1787580182.088298:0:15077:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1787580182.088688:0:15077:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 641: rc = 0 00100000:10000000:3.0:1787580182.088840:0:15077:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 641: rc = 0 00100000:10000000:3.0:1787580182.088934:0:15077:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 641: rc = 0 00100000:10000000:3.0:1787580182.092333:0:15077:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 327: rc = 0 00100000:10000000:3.0:1787580182.099814:0:15077:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 327: rc = 0 00100000:10000000:3.0:1787580182.100279:0:15077:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 327: rc = 0 00100000:10000000:3.0:1787580182.100551:0:15077:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 327: rc = 0 00100000:10000000:2.0:1787580182.106156:0:15077:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 327: rc = 0 00100000:10000000:2.0:1787580182.107006:0:15077:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 327: rc = 0 00000020:00000080:2.0:1787580182.107759:0:15077:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787580182.107770:0:15077:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787580182.107781:0:15077:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc86deac208338827 00000020:01000004:2.0:1787580182.107789:0:15077:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1787580182.107809:0:15077:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.136@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787580182.107812:0:15077:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.136@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787580182.107818:0:15077:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787580182.107823:0:15077:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1787580182.107834:0:15077:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8fae7e9d8000) 00000020:00000080:2.0:1787580182.107845:0:15077:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:2.0:1787580182.111444:0:15077:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787580182.114004:0:15077:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1787580182.114016:0:15077:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1787580182.116165:0:15077:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1787580182.116178:0:15077:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1787580182.116984:0:15077:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1787580182.116995:0:15077:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00080000:0.0:1787580182.133332:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787580182.133340:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787580182.133343:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787580182.133346:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787580182.133380:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787580182.133416:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7e97e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874413262827392:0@lo:400:kworker.0 00000100:00100000:0.0:1787580182.133490:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580182.133562:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262827392 00000100:00100000:0.0:1787580182.133582:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262827392 00000100:00100000:0.0:1787580182.133645:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787580182.133655:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7e97f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874413262827392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787580182.133708:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7e97f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874413262827392:12345-0@lo:400:kworker.0 Request processed in 54us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580182.133715:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787580182.133767:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8fae7e97e300 x1874413262827392/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787580198 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787580182.133780:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7e97e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874413262827392:0@lo:400:kworker.0 00000100:00100000:1.0:1787580182.134039:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7e97c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5949e638-96f6-489a-aea1-b9b80ed3224f:3317:1874413262827264:0@lo:400:kworker.0 00000100:00100000:1.0:1787580182.134077:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787580182.134118:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262827264 00000100:00100000:1.0:1787580182.134122:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262827264 00000100:00100000:1.0:1787580182.134151:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787580182.134157:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6e8a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5949e638-96f6-489a-aea1-b9b80ed3224f+12:3317:x1874413262827264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787580182.134204:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6e8a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5949e638-96f6-489a-aea1-b9b80ed3224f+12:3317:x1874413262827264:12345-0@lo:400:kworker.0 Request processed in 47us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580182.134211:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787580182.134347:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7e97c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5949e638-96f6-489a-aea1-b9b80ed3224f:3317:1874413262827264:0@lo:400:kworker.0 00000100:00100000:1.0:1787580182.139866:0:15077:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787580182.140097:0:15077:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1787580182.140104:0:15077:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1787580182.144581:0:15077:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1787580182.144601:0:15077:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1787580182.172045:0:15077:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787580182.172305:0:15077:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787580182.172313:0:15077:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1787580182.185497:0:15077:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787580182.185519:0:15077:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1787580182.186501:0:15077:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787580182.186511:0:15077:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1787580182.194296:0:15077:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787580182.194760:0:15077:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1787580182.194767:0:15077:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1787580182.195850:0:15077:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1787580182.195943:0:15077:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1787580182.280505:0:15077:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787580182.280755:0:15077:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1787580182.280761:0:15077:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1787580182.282263:0:15077:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1787580182.282274:0:15077:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1787580182.283070:0:15077:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1787580182.283099:0:15077:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1787580182.283106:0:15077:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.136@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1787580182.299897:0:15077:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.136@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787580182.299937:0:15077:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.136@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1787580182.299942:0:15077:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787580182.299944:0:15077:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787580182.299945:0:15077:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787580182.299946:0:15077:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787580182.299947:0:15077:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787580182.299948:0:15077:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787580182.299950:0:15077:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787580182.299952:0:15077:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787580182.299953:0:15077:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787580182.299957:0:15077:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1787580182.299959:0:15077:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787580182.299960:0:15077:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787580182.299961:0:15077:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787580182.299962:0:15077:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787580182.299963:0:15077:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787580182.300036:0:15077:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787580182.300039:0:15077:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787580182.300040:0:15077:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787580182.300041:0:15077:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787580182.300069:0:15077:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787580182.300089:0:15077:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5072bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:15077:1874413262827520:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787580182.300172:0:15077:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787580182.300350:0:15077:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae48647f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787580182.304727:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262827520 00000100:00100000:0.0:1787580182.304746:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262827520 00000100:00100000:0.0:1787580182.304853:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787580182.304864:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6e8a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5949e638-96f6-489a-aea1-b9b80ed3224f+12:15077:x1874413262827520:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787580182.304929:0:14390:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787580182.304934:0:14390:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1787580182.304938:0:14390:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1787580182.323194:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6e8a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5949e638-96f6-489a-aea1-b9b80ed3224f+12:15077:x1874413262827520:12345-0@lo:253:mount.lustre.0 Request processed in 18320us (23010us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580182.323219:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787580182.323380:0:15077:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5072bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:15077:1874413262827520:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787580182.323452:0:15077:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787580182.323456:0:15077:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787580182.323458:0:15077:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787580182.323459:0:15077:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787580182.323460:0:15077:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787580182.323461:0:15077:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787580182.323462:0:15077:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787580182.323464:0:15077:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787580182.323465:0:15077:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787580182.323467:0:15077:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787580182.323487:0:15077:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8fae51c01000 from lustre-OST0000 10000000:01000000:1.0:1787580182.323513:0:15077:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1787580182.323516:0:15077:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787580182.323523:0:15077:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8fae6d5419b8 local copy 00010000:00010000:1.0:1787580182.323533:0:15077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae5f6d7e00/0xc86deac20833871d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208338724 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580182.323767:0:15077:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5072bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:15077:1874413262827648:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787580182.323806:0:15077:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787580182.323843:0:15077:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae48647c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787580182.323977:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262827648 00000100:00100000:2.0:1787580182.323984:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262827648 00000100:00100000:2.0:1787580182.324027:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787580182.324037:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6e8a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5949e638-96f6-489a-aea1-b9b80ed3224f+12:15077:x1874413262827648:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787580182.324184:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6e8a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5949e638-96f6-489a-aea1-b9b80ed3224f+12:15077:x1874413262827648:12345-0@lo:501:mount.lustre.0 Request processed in 148us (378us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787580182.324191:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787580182.324346:0:15077:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5072bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:15077:1874413262827648:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1787580182.324360:0:15077:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.136@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787580182.324540:0:15077:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.136@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787580182.324547:0:15077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae5f6d7e00/0xc86deac20833871d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208338724 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580182.324557:0:15077:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff8fae5f6d7e00/0xc86deac20833871d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208338724 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787580182.324586:0:15077:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8fae51c01000 10000000:01000000:0.0:1787580182.324591:0:15077:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787580182.324596:0:15077:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8fae6d5419b8 10000000:01000000:0.0:1787580182.324598:0:15077:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1787580182.324602:0:15077:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8fae6d5419b8 from 1 10000000:01000000:0.0:1787580182.324604:0:15077:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1787580182.324631:0:15077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae50feae00/0xc86deac208338835 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580182.324638:0:15077:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff8fae50feae00/0xc86deac208338835 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580182.324655:0:15077:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff8fae50feae00/0xc86deac208338835 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580182.324670:0:15077:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7e97c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:15077:1874413262827776:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787580182.324702:0:15077:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580182.324729:0:15077:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae49ef1300 going to sleep for 11 seconds 00000100:00100000:2.0:1787580182.324844:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262827776 00000100:00100000:2.0:1787580182.324849:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262827776 00000100:00100000:2.0:1787580182.324882:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787580182.324889:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6e8a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5949e638-96f6-489a-aea1-b9b80ed3224f+12:15077:x1874413262827776:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787580182.324898:0:14390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787580182.324909:0:14390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fae48db9400/0xc86deac20833883c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc86deac208338835 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580182.324929:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fae48db9400/0xc86deac20833883c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc86deac208338835 expref: 13 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580182.324939:0:14390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fae48db9400/0xc86deac20833883c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac208338835 expref: 13 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580182.324948:0:14390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae48db9400, rc 0) 00000100:00100000:2.0:1787580182.324987:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6e8a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5949e638-96f6-489a-aea1-b9b80ed3224f+13:15077:x1874413262827776:12345-0@lo:101:mount.lustre.0 Request processed in 98us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580182.324999:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787580182.325956:0:15077:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7e97c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:15077:1874413262827776:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787580182.325985:0:15077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff8fae50feae00/0xc86deac208338835 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac20833883c expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580182.325996:0:15077:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff8fae50feae00/0xc86deac208338835 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc86deac20833883c expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787580182.326016:0:15077:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1787580182.326036:0:15077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae50feae00/0xc86deac208338835 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac20833883c expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580182.326044:0:15077:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff8fae50feae00/0xc86deac208338835 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac20833883c expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787580182.326052:0:15077:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1787580182.326057:0:15077:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787580182.326062:0:15077:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1787580182.326065:0:15077:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787580182.326083:0:15077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae50feba00/0xc86deac208338843 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580182.326091:0:15077:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff8fae50feba00/0xc86deac208338843 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580182.326108:0:15077:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff8fae50feba00/0xc86deac208338843 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580182.326123:0:15077:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7e97c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:15077:1874413262827904:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787580182.326176:0:15077:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580182.326307:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262827904 00000100:00100000:3.0:1787580182.326313:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262827904 00000100:00100000:3.0:1787580182.326351:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787580182.326359:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6e8a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5949e638-96f6-489a-aea1-b9b80ed3224f+13:15077:x1874413262827904:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787580182.326371:0:14390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787580182.326406:0:14390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fae5f6d6000/0xc86deac20833884a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc86deac208338843 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580182.326422:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fae5f6d6000/0xc86deac20833884a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc86deac208338843 expref: 14 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580182.326432:0:14390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fae5f6d6000/0xc86deac20833884a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac208338843 expref: 14 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580182.326439:0:14390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae5f6d6000, rc 0) 00000100:00100000:3.0:1787580182.326469:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6e8a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5949e638-96f6-489a-aea1-b9b80ed3224f+14:15077:x1874413262827904:12345-0@lo:101:mount.lustre.0 Request processed in 112us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580182.326476:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787580182.326677:0:15077:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae49ef1300 going to sleep for 11 seconds 00000100:00100000:0.0:1787580182.326692:0:15077:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7e97c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:15077:1874413262827904:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787580182.326703:0:15077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff8fae50feba00/0xc86deac208338843 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac20833884a expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580182.326711:0:15077:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff8fae50feba00/0xc86deac208338843 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc86deac20833884a expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787580182.327908:0:15077:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1787580182.328950:0:15077:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787580182.330287:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1787580182.330360:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1787580182.330432:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1787580182.330484:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1787580182.330518:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1787580182.330546:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1787580182.332956:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1787580182.332986:0:15077:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1787580182.333087:0:15077:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5072b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:15077:1874413262828032:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787580182.333155:0:15077:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580182.336465:0:15077:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae48647900 going to sleep for 11 seconds 00000100:00100000:0.0:1787580182.336674:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262828032 00000100:00100000:0.0:1787580182.336683:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262828032 00000100:00100000:1.0:1787580182.336843:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787580182.336853:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74f08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5949e638-96f6-489a-aea1-b9b80ed3224f+14:15077:x1874413262828032:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787580182.337590:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74f08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5949e638-96f6-489a-aea1-b9b80ed3224f+14:15077:x1874413262828032:12345-0@lo:501:mount.lustre.0 Request processed in 737us (4433us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580182.337599:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787580182.337779:0:15077:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5072b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:15077:1874413262828032:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787580182.337828:0:15077:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7e97c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:15077:1874413262828160:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787580182.337875:0:15077:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580182.338349:0:15077:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae49ef1300 going to sleep for 11 seconds 00000100:00100000:1.0:1787580182.338413:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262828160 00000100:00100000:1.0:1787580182.338419:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262828160 00000100:00100000:1.0:1787580182.338460:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787580182.338468:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74f0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5949e638-96f6-489a-aea1-b9b80ed3224f+14:15077:x1874413262828160:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787580182.338787:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74f0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5949e638-96f6-489a-aea1-b9b80ed3224f+14:15077:x1874413262828160:12345-0@lo:503:mount.lustre.0 Request processed in 318us (911us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580182.338794:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787580182.341631:0:15077:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7e97c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:15077:1874413262828160:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787580182.342717:0:15077:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787580182.342808:0:15077:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7e97c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:15077:1874413262828288:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787580182.342901:0:15077:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580182.342946:0:15077:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae49ef1300 going to sleep for 11 seconds 00000100:00100000:1.0:1787580182.344073:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262828288 00000100:00100000:1.0:1787580182.344085:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262828288 00000100:00100000:1.0:1787580182.344144:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787580182.344154:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74f0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5949e638-96f6-489a-aea1-b9b80ed3224f+14:15077:x1874413262828288:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787580182.344480:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74f0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5949e638-96f6-489a-aea1-b9b80ed3224f+14:15077:x1874413262828288:12345-0@lo:502:mount.lustre.0 Request processed in 327us (1578us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580182.344488:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787580182.346759:0:15077:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7e97c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:15077:1874413262828288:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787580182.347094:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1787580182.347155:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1787580182.349211:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1787580182.349355:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1787580182.349418:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1787580182.349456:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1787580182.349503:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1787580182.349535:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1787580182.349564:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:0.0:1787580182.349608:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:0.0:1787580182.349643:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:0.0:1787580182.349715:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:0.0:1787580182.349765:0:15077:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7e97c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:15077:1874413262828416:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787580182.349847:0:15077:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580182.349899:0:15077:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae49ef1300 going to sleep for 11 seconds 00000100:00100000:2.0:1787580182.350702:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262828416 00000100:00100000:2.0:1787580182.350713:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262828416 00000100:00100000:2.0:1787580182.350770:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787580182.350781:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74f0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5949e638-96f6-489a-aea1-b9b80ed3224f+14:15077:x1874413262828416:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787580182.351030:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74f0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5949e638-96f6-489a-aea1-b9b80ed3224f+14:15077:x1874413262828416:12345-0@lo:502:mount.lustre.0 Request processed in 250us (1184us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580182.351038:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787580182.352171:0:15077:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7e97c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:15077:1874413262828416:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787580182.354188:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:0.0:1787580182.354226:0:15077:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:0.0:1787580182.355827:0:15091:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787580182.355837:0:15091:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1787580182.355844:0:15091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787580182.355846:0:15091:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1787580182.355852:0:15091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787580182.355877:0:15091:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8fae74decd28) 00000020:00000080:0.0:1787580182.355901:0:15091:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787580182.355907:0:15091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787580182.355999:0:15091:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8fae51c01000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1787580182.356008:0:15091:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787580182.356016:0:15091:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc86deac208338858 00010000:00010000:1.0:1787580182.368203:0:15091:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:1.0:1787580182.368649:0:15091:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:2.0:1787580182.386585:0:15091:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1787580182.390255:0:15091:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1787580182.390272:0:15091:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787580182.390280:0:15091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787580182.390282:0:15091:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1787580182.390288:0:15091:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787580182.390291:0:15091:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:2.0:1787580182.390293:0:15091:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787580182.390295:0:15091:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787580182.390307:0:15091:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787580182.390310:0:15091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787580182.390312:0:15091:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787580182.390315:0:15091:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787580182.390318:0:15091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787580182.390319:0:15091:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787580182.390322:0:15091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787580182.390324:0:15091:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787580182.390326:0:15091:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787580182.390328:0:15091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787580182.390329:0:15091:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787580182.390331:0:15091:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787580182.390333:0:15091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787580182.390334:0:15091:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787580182.390345:0:15091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1787580182.390428:0:15091:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787580182.390432:0:15091:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787580182.390434:0:15091:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787580182.390437:0:15091:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1787580182.390666:0:15077:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1787580182.390694:0:15077:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1787580182.390719:0:15077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae50feba00/0xc86deac208338843 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac20833884a expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580182.390742:0:15077:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff8fae50feba00/0xc86deac208338843 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac20833884a expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787580182.390750:0:15077:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8fae51c01000 from 1 10000000:01000000:3.0:1787580182.390753:0:15077:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787580182.390799:0:15077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae5f6d6200/0xc86deac20833885f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580182.390807:0:15077:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff8fae5f6d6200/0xc86deac20833885f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580182.390818:0:15077:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff8fae5f6d6200/0xc86deac20833885f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580182.390843:0:15077:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae507b9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:15077:1874413262828544:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787580182.390909:0:15077:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580182.390955:0:15077:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae48cb7a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787580182.391426:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262828544 00000100:00100000:2.0:1787580182.391434:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262828544 00000100:00100000:2.0:1787580182.391488:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787580182.391500:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74f0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5949e638-96f6-489a-aea1-b9b80ed3224f+14:15077:x1874413262828544:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787580182.391513:0:14389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787580182.391526:0:14389:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fae48db9000/0xc86deac208338866 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc86deac20833885f expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580182.391553:0:14389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fae48db9000/0xc86deac208338866 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc86deac20833885f expref: 15 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580182.391564:0:14389:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fae48db9000/0xc86deac208338866 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac20833885f expref: 15 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580182.391585:0:14389:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae48db9000, rc 0) 00000100:00100000:2.0:1787580182.391627:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74f0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5949e638-96f6-489a-aea1-b9b80ed3224f+15:15077:x1874413262828544:12345-0@lo:101:mount.lustre.0 Request processed in 129us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580182.391634:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787580182.391776:0:15077:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae507b9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:15077:1874413262828544:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787580182.391798:0:15077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff8fae5f6d6200/0xc86deac20833885f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208338866 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580182.391808:0:15077:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff8fae5f6d6200/0xc86deac20833885f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc86deac208338866 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787580182.392345:0:15077:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1787580182.392746:0:15077:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787580182.392992:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1787580182.393037:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1787580182.393102:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1787580182.393111:0:15077:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1787580182.393169:0:15077:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7e97c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:15077:1874413262828672:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787580182.393215:0:15077:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580182.393256:0:15077:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae49ef1000 going to sleep for 11 seconds 00000100:00100000:2.0:1787580182.393441:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262828672 00000100:00100000:2.0:1787580182.393448:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262828672 00000100:00100000:2.0:1787580182.393482:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787580182.393492:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74f09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5949e638-96f6-489a-aea1-b9b80ed3224f+15:15077:x1874413262828672:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787580182.393711:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74f09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5949e638-96f6-489a-aea1-b9b80ed3224f+15:15077:x1874413262828672:12345-0@lo:501:mount.lustre.0 Request processed in 219us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580182.393729:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787580182.394750:0:15077:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7e97c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:15077:1874413262828672:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787580182.394794:0:15077:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7e97c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:15077:1874413262828800:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787580182.394844:0:15077:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580182.394922:0:15077:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae49ef1000 going to sleep for 11 seconds 00000100:00100000:3.0:1787580182.412322:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262828800 00000100:00100000:3.0:1787580182.412339:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262828800 00000100:00100000:3.0:1787580182.412427:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787580182.412439:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74f09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5949e638-96f6-489a-aea1-b9b80ed3224f+15:15077:x1874413262828800:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787580182.412701:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74f09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5949e638-96f6-489a-aea1-b9b80ed3224f+15:15077:x1874413262828800:12345-0@lo:503:mount.lustre.0 Request processed in 263us (17856us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580182.412708:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787580182.416327:0:15077:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7e97c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:15077:1874413262828800:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787580182.417068:0:15077:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787580182.417146:0:15077:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7e97c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:15077:1874413262828928:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787580182.417225:0:15077:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580182.417268:0:15077:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae56f0f840 going to sleep for 11 seconds 00000100:00100000:2.0:1787580182.419264:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262828928 00000100:00100000:2.0:1787580182.419278:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262828928 00000100:00100000:2.0:1787580182.419348:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787580182.419359:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74f09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5949e638-96f6-489a-aea1-b9b80ed3224f+15:15077:x1874413262828928:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787580182.419651:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74f09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5949e638-96f6-489a-aea1-b9b80ed3224f+15:15077:x1874413262828928:12345-0@lo:502:mount.lustre.0 Request processed in 293us (2426us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580182.419659:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787580182.420025:0:15077:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7e97c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:15077:1874413262828928:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787580182.420361:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1787580182.420448:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1787580182.420497:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1787580182.420533:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1787580182.420579:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1787580182.420637:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1787580182.420675:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1787580182.421361:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1787580182.421443:0:15077:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae50729c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:15077:1874413262829056:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787580182.421515:0:15077:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787580182.421563:0:15077:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae5dd21600 going to sleep for 11 seconds 00000100:00100000:0.0:1787580182.421661:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262829056 00000100:00100000:0.0:1787580182.421669:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262829056 00000100:00100000:0.0:1787580182.421986:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787580182.422005:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74f08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5949e638-96f6-489a-aea1-b9b80ed3224f+15:15077:x1874413262829056:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787580182.422214:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74f08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5949e638-96f6-489a-aea1-b9b80ed3224f+15:15077:x1874413262829056:12345-0@lo:502:mount.lustre.0 Request processed in 210us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580182.422222:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787580182.422471:0:15077:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae50729c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:15077:1874413262829056:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787580182.422611:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1787580182.422622:0:15077:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1787580182.428459:0:15095:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787580182.428473:0:15095:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787580182.428475:0:15095:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787580182.428484:0:15095:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8fae51c01000 00000020:00000080:3.0:1787580182.428497:0:15095:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787580182.428511:0:15095:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787580182.428514:0:15095:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787580182.428515:0:15095:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787580182.428518:0:15095:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787580182.428521:0:15095:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787580182.428522:0:15095:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787580182.428526:0:15095:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8fae51c01000 00000020:00000080:3.0:1787580182.428528:0:15095:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787580182.428595:0:15095:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787580182.428599:0:15095:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787580182.428601:0:15095:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787580182.428604:0:15095:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787580182.428606:0:15095:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787580182.428608:0:15095:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787580182.428611:0:15095:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8fae51c01000 00000020:00000080:3.0:1787580182.428613:0:15095:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787580182.428646:0:15095:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787580182.428649:0:15095:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787580182.428650:0:15095:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787580182.428653:0:15095:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1787580182.429001:0:15077:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1787580182.429028:0:15077:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787580182.429044:0:15077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae5f6d6200/0xc86deac20833885f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208338866 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580182.429053:0:15077:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff8fae5f6d6200/0xc86deac20833885f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208338866 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787580182.429089:0:15077:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787580182.429092:0:15077:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8fae51c01000 10000000:01000000:2.0:1787580182.429094:0:15077:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8fae51c01000 10000000:01000000:2.0:1787580182.429098:0:15077:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787580182.429102:0:15077:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8fae51c01000 from 1 10000000:01000000:2.0:1787580182.429104:0:15077:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787580182.429137:0:15077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae48db9a00/0xc86deac20833886d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580182.429143:0:15077:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff8fae48db9a00/0xc86deac20833886d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580182.429152:0:15077:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff8fae48db9a00/0xc86deac20833886d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580182.429192:0:15077:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d5baa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:15077:1874413262829184:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787580182.429264:0:15077:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787580182.429307:0:15077:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae6d747cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787580182.430366:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262829184 00000100:00100000:3.0:1787580182.430378:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262829184 00000100:00100000:3.0:1787580182.430500:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787580182.430513:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74f0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5949e638-96f6-489a-aea1-b9b80ed3224f+15:15077:x1874413262829184:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787580182.430531:0:14390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787580182.430548:0:14390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fae5f6d7800/0xc86deac208338874 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc86deac20833886d expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580182.430575:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fae5f6d7800/0xc86deac208338874 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc86deac20833886d expref: 16 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580182.430613:0:14390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fae5f6d7800/0xc86deac208338874 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac20833886d expref: 16 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580182.430622:0:14390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae5f6d7800, rc 0) 00000100:00100000:3.0:1787580182.430682:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74f0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5949e638-96f6-489a-aea1-b9b80ed3224f+16:15077:x1874413262829184:12345-0@lo:101:mount.lustre.0 Request processed in 173us (1417us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580182.430690:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787580182.431107:0:15077:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d5baa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:15077:1874413262829184:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787580182.431128:0:15077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff8fae48db9a00/0xc86deac20833886d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208338874 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580182.431137:0:15077:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff8fae48db9a00/0xc86deac20833886d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc86deac208338874 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787580182.434265:0:15077:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1787580182.435841:0:15077:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787580182.436209:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1787580182.436256:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1787580182.436309:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1787580182.436372:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1787580182.436436:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1787580182.436497:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1787580182.436537:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1787580182.436577:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1787580182.436651:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1787580182.436709:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1787580182.436767:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1787580182.436845:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1787580182.436909:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1787580182.436963:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1787580182.437052:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1787580182.437112:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1787580182.437163:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1787580182.437266:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1787580182.437351:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1787580182.437433:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1787580182.437517:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1787580182.437596:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1787580182.437642:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1787580182.437718:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1787580182.437804:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1787580182.437877:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1787580182.439270:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1787580182.439345:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1787580182.439428:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1787580182.439434:0:15077:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1787580182.439527:0:15077:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d5baa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:15077:1874413262829312:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787580182.439597:0:15077:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787580182.439638:0:15077:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae6d747cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787580182.439904:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262829312 00000100:00100000:3.0:1787580182.439911:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262829312 00000100:00100000:3.0:1787580182.439977:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787580182.439989:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74f0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5949e638-96f6-489a-aea1-b9b80ed3224f+16:15077:x1874413262829312:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787580182.440217:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74f0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5949e638-96f6-489a-aea1-b9b80ed3224f+16:15077:x1874413262829312:12345-0@lo:501:mount.lustre.0 Request processed in 230us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580182.440225:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787580182.440420:0:15077:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d5baa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:15077:1874413262829312:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787580182.440448:0:15077:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d5baa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:15077:1874413262829440:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787580182.440479:0:15077:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787580182.440498:0:15077:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae6d747cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787580182.440560:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262829440 00000100:00100000:3.0:1787580182.440611:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262829440 00000100:00100000:3.0:1787580182.440638:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787580182.440643:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74f0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5949e638-96f6-489a-aea1-b9b80ed3224f+16:15077:x1874413262829440:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787580182.441019:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74f0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5949e638-96f6-489a-aea1-b9b80ed3224f+16:15077:x1874413262829440:12345-0@lo:503:mount.lustre.0 Request processed in 374us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580182.441027:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787580182.445223:0:15077:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d5baa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:15077:1874413262829440:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787580182.448982:0:15077:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787580182.449099:0:15077:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae507b8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:15077:1874413262829568:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787580182.449178:0:15077:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580182.450671:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262829568 00000100:00100000:0.0:1787580182.450681:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262829568 00000100:00100000:3.0:1787580182.450706:0:15077:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae48cb7a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787580182.450730:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787580182.450737:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74f09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5949e638-96f6-489a-aea1-b9b80ed3224f+16:15077:x1874413262829568:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787580182.450962:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74f09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5949e638-96f6-489a-aea1-b9b80ed3224f+16:15077:x1874413262829568:12345-0@lo:502:mount.lustre.0 Request processed in 224us (1784us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580182.450978:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787580182.451105:0:15077:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae507b8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:15077:1874413262829568:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787580182.451930:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1787580182.452003:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1787580182.452038:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1787580182.452086:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1787580182.452122:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1787580182.452165:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1787580182.452201:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1787580182.452234:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1787580182.452276:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1787580182.453562:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1787580182.453637:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1787580182.453705:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1787580182.453821:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1787580182.453858:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1787580182.453935:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1787580182.453984:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1787580182.454023:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1787580182.454072:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1787580182.454107:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1787580182.454140:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1787580182.454187:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1787580182.454220:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1787580182.454253:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1787580182.454295:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1787580182.454784:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1787580182.454820:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1787580182.454872:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1787580182.454910:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1787580182.454945:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1787580182.455008:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1787580182.455063:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1787580182.455110:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1787580182.455141:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1787580182.455201:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1787580182.455241:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1787580182.455284:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1787580182.455331:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1787580182.455361:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1787580182.455430:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1787580182.455467:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1787580182.455516:0:15077:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae507b8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:15077:1874413262829696:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787580182.455601:0:15077:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580182.455649:0:15077:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae48cb7a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787580182.455876:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262829696 00000100:00100000:0.0:1787580182.455884:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262829696 00000100:00100000:0.0:1787580182.455937:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787580182.455947:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae42b3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5949e638-96f6-489a-aea1-b9b80ed3224f+16:15077:x1874413262829696:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787580182.456183:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae42b3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5949e638-96f6-489a-aea1-b9b80ed3224f+16:15077:x1874413262829696:12345-0@lo:502:mount.lustre.0 Request processed in 235us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580182.456192:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787580182.456219:0:15077:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae507b8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:15077:1874413262829696:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787580182.456290:0:15077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1787580182.456300:0:15077:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1787580182.458149:0:15100:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1787580182.458181:0:15100:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8fad42a88000) 00000020:00000080:2.0:1787580182.458202:0:15100:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1787580182.458694:0:15100:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8fae51c01000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787580182.458699:0:15100:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8fae51c01000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787580182.458701:0:15100:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8fae51c01000 3 00010000:00080000:3.0:1787580182.458798:0:15100:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8fae6d1e5000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.136@tcp at head 00010000:00010000:3.0:1787580182.463928:0:15100:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:3.0:1787580182.464153:0:15100:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1787580182.464208:0:15100:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787580182.464221:0:15100:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xc86deac208338882 00000100:00080000:3.0:1787580182.464231:0:15100:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787580182.464236:0:15100:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8fae6d1e5000 using connection 192.168.202.136@tcp/0@lo 00000100:00100000:3.0:1787580182.464285:0:15100:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fae507b8700 x1874413262829824/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787580182.464361:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae507b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3313:1874413262829824:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787580182.464469:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787580182.464662:0:15100:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787580182.465317:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262829824 00000100:00100000:0.0:1787580182.465326:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262829824 00000100:00100000:0.0:1787580182.465368:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787580182.465376:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d5baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3313:x1874413262829824:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787580182.465426:0:14397:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 530 last 0 00000020:00000080:0.0:1787580182.465456:0:14397:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xc86deac208338889 00000004:00100000:0.0:1787580182.465471:0:14397:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787580182.465500:0:14397:0:(import.c:65:import_set_state_nolock()) ffff8fae50613800 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1787580182.466654:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787580182.466660:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787580182.466663:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787580182.466665:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787580182.466716:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787580182.466730:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae50729c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874413262829952:0@lo:400:kworker.0 00000100:00100000:1.0:1787580182.466768:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787580182.466806:0:14396:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1787580182.466814:0:14396:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1787580182.472686:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262829952 00000100:00100000:1.0:1787580182.472701:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262829952 00000100:00100000:1.0:1787580182.472754:0:14396:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1787580182.472769:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787580182.472779:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae50728380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874413262829952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787580182.472876:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae50728380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874413262829952:12345-0@lo:400:kworker.0 Request processed in 98us (6106us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580182.472883:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787580182.472931:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8fae50729c00 x1874413262829952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787580198 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787580182.472946:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae50729c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874413262829952:0@lo:400:kworker.0 00000100:00100000:0.0:1787580182.473485:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d5baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874413262829824:12345-0@lo:38:llog_process_th.0 Request processed in 8105us (9012us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580182.473495:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:00080000:0.0:1787580182.473683:0:15100:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1787580182.473763:0:15077:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1787580182.473797:0:15077:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787580182.473816:0:15077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae48db9a00/0xc86deac20833886d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208338874 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580182.473824:0:15077:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff8fae48db9a00/0xc86deac20833886d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208338874 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787580182.473870:0:15077:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787580182.473871:0:15077:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787580182.473872:0:15077:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787580182.473873:0:15077:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787580182.473874:0:15077:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787580182.473875:0:15077:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787580182.473876:0:15077:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787580182.473878:0:15077:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787580182.473879:0:15077:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787580182.473882:0:15077:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1787580182.473884:0:15077:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787580182.473884:0:15077:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787580182.473885:0:15077:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787580182.473886:0:15077:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787580182.473886:0:15077:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787580182.473887:0:15077:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787580182.473887:0:15077:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787580182.473888:0:15077:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787580182.473891:0:15077:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787580182.473909:0:15077:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787580182.473922:0:15077:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae50729c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:15077:1874413262830080:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787580182.473961:0:15077:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787580182.474009:0:15077:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae4722d240 going to sleep for 11 seconds 00000100:00100000:0.0:1787580182.475947:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262830080 00000100:00100000:0.0:1787580182.475958:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262830080 00000100:00100000:0.0:1787580182.476025:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787580182.476035:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae42b3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5949e638-96f6-489a-aea1-b9b80ed3224f+16:15077:x1874413262830080:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787580182.476066:0:14389:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787580182.476081:0:14389:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:2.0:1787580182.478697:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8fae507b8700 x1874413262829824/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787580192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787580182.478736:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787580182.478747:0:3313:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1787580182.478755:0:3313:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787580182.478761:0:3313:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787580182.478764:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8fae6d1e5000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787580182.478772:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae507b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3313:1874413262829824:0@lo:38:llog_process_th.0 20000000:01000000:1.0:1787580182.536249:0:14389:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787580182.536271:0:14389:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1787580182.536336:0:14411:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787580182.536342:0:14411:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787580182.536365:0:14411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8fae50fea200/0xc86deac208338890 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580182.536411:0:14411:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fae48db8000/0xc86deac2083387fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac2083387f6 expref: 16 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580182.536419:0:14411:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8fae50fea200/0xc86deac208338890 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580182.536461:0:14411:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fae48db8000/0xc86deac2083387fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc86deac2083387f6 expref: 16 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580182.536478:0:14411:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8fae48db8000/0xc86deac2083387fd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc86deac2083387f6 expref: 16 pid: 14389 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580182.536493:0:14411:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7e97e300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14411:1874413262830208:0@lo:104: 00000100:00100000:0.0:1787580182.536559:0:14411:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580182.536600:0:14411:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae5061b900 going to sleep for 11 seconds 00000100:00100000:1.0:1787580182.536887:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262830208 00000100:00100000:1.0:1787580182.536895:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262830208 00000100:00100000:1.0:1787580182.536947:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787580182.536988:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7e97dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5949e638-96f6-489a-aea1-b9b80ed3224f+3:14411:x1874413262830208:12345-0@lo:104: 00010000:00010000:1.0:1787580182.537002:0:14378:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.136@tcp lock: ffff8fae5f6d7000/0xc86deac2083387f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc86deac2083387fd expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580182.537054:0:14378:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787580182.537060:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7e97dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5949e638-96f6-489a-aea1-b9b80ed3224f+3:14411:x1874413262830208:12345-0@lo:104: Request processed in 76us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580182.537067:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1787580182.537359:0:14383:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787580182.537367:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.136@tcp lock: ffff8fae5f6d7000/0xc86deac2083387f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc86deac2083387fd expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580182.537375:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae5f6d7000 already unused, calling callback (ffffffffc1b77c20) 10000000:00010000:0.0:1787580182.537380:0:14383:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.136@tcp lock: ffff8fae5f6d7000/0xc86deac2083387f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc86deac2083387fd expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580182.537419:0:14383:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: ffff8fae5f6d7000/0xc86deac2083387f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc86deac2083387fd expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787580182.537427:0:14383:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: ffff8fae5f6d7000/0xc86deac2083387f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc86deac2083387fd expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787580182.537433:0:14383:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787580182.537463:0:14383:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.136@tcp lock: ffff8fae5f6d7000/0xc86deac2083387f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac2083387fd expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580182.537469:0:14383:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787580182.537498:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.136@tcp lock: ffff8fae5f6d7000/0xc86deac2083387f6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac2083387fd expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580182.537506:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: ffff8fae5f6d7000/0xc86deac2083387f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac2083387fd expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580182.537522:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787580182.537524:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787580182.537525:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787580182.537538:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787580182.537547:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7e97ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5949e638-96f6-489a-aea1-b9b80ed3224f:3317:1874413262830336:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787580182.537578:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580182.537637:0:14411:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7e97e300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14411:1874413262830208:0@lo:104: 00010000:00010000:0.0:1787580182.537659:0:14411:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8fae50fea200/0xc86deac208338890 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580182.537886:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262830336 00000100:00100000:3.0:1787580182.537891:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262830336 00010000:00010000:3.0:1787580182.537913:0:14382:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fae48db8000/0xc86deac2083387fd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc86deac2083387f6 expref: 17 pid: 14389 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580182.537958:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787580182.537976:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7e97ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5949e638-96f6-489a-aea1-b9b80ed3224f+17:3317:x1874413262830336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787580182.537987:0:14382:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787580182.537992:0:14382:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fae48db8000/0xc86deac2083387fd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc86deac2083387f6 expref: 17 pid: 14389 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580182.538002:0:14382:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fae48db8000/0xc86deac2083387fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc86deac2083387f6 expref: 17 pid: 14389 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580182.538017:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fae48db8000/0xc86deac2083387fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc86deac2083387f6 expref: 17 pid: 14389 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580182.538029:0:14382:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8fae50fea200/0xc86deac208338890 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580182.538036:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fae50fea200/0xc86deac208338890 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787580182.538049:0:14382:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006060868s 00010000:00010000:3.0:1787580182.538053:0:14382:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fae50fea200/0xc86deac208338890 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580182.538060:0:14382:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fae50fea200/0xc86deac208338890 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580182.538068:0:14382:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8fae50fea200/0xc86deac208338890 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580182.538074:0:14382:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8fae50fea200/0xc86deac208338890 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580182.538086:0:14382:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae50fea200 already unused, calling callback (ffffffffc155a230) 00010000:00010000:3.0:1787580182.538090:0:14382:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8fae50fea200/0xc86deac208338890 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580182.538097:0:14382:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8fae50fea200/0xc86deac208338890 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580182.538111:0:14382:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8fae50fea200/0xc86deac208338890 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580182.538120:0:14382:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787580182.538154:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7e97ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5949e638-96f6-489a-aea1-b9b80ed3224f+16:3317:x1874413262830336:12345-0@lo:103:ldlm_bl.0 Request processed in 188us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580182.538161:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787580182.538188:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7e97ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5949e638-96f6-489a-aea1-b9b80ed3224f:3317:1874413262830336:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787580182.538206:0:14411:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8fae50fea200/0xc86deac208338890 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580182.538214:0:14411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8fae50fea200/0xc86deac208338890 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580182.538220:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fae50fea200/0xc86deac208338890 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580182.575565:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae42b3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5949e638-96f6-489a-aea1-b9b80ed3224f+15:15077:x1874413262830080:12345-0@lo:253:mount.lustre.0 Request processed in 99522us (101592us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580182.575582:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787580182.575701:0:15077:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae50729c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:15077:1874413262830080:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787580182.575718:0:15077:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1787580182.575722:0:15077:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787580182.575723:0:15077:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787580182.575739:0:15077:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787580182.575740:0:15077:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787580182.575741:0:15077:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787580182.575742:0:15077:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787580182.575744:0:15077:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787580182.575756:0:15077:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787580182.575758:0:15077:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787580182.575776:0:15077:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787580182.584349:0:15077:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1787580182.586122:0:15077:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787580182.586297:0:15077:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1787580182.586477:0:15077:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787580182.586617:0:15077:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1787580182.588248:0:15077:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1787580182.592468:0:15077:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1787580182.731165:0:15077:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1787580182.731175:0:15077:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1787580182.731209:0:15077:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787580182.731272:0:15077:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.136@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787580182.731288:0:15077:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1787580182.731318:0:15077:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1787580182.773909:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787580183.605313:0:14393:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787580183.605321:0:14393:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8fae50b5d800 from 7 10000000:01000000:1.0:1787580183.605326:0:14393:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787580183.605373:0:14393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae4ca58000/0xc86deac208338897 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580183.605418:0:14393:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff8fae4ca58000/0xc86deac208338897 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580183.605453:0:14393:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff8fae4ca58000/0xc86deac208338897 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580183.605481:0:14393:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae50729c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5949e638-96f6-489a-aea1-b9b80ed3224f:14393:1874413262830464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787580183.605551:0:14393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787580183.605601:0:14393:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae48d7c600 going to sleep for 11 seconds 00000100:00100000:0.0:1787580183.605687:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262830464 00000100:00100000:0.0:1787580183.605696:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262830464 00000100:00100000:0.0:1787580183.605745:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787580183.605756:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae42b3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5949e638-96f6-489a-aea1-b9b80ed3224f+15:14393:x1874413262830464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787580183.605769:0:14388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787580183.605782:0:14388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fae50feaa00/0xc86deac20833889e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc86deac208338897 expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580183.605805:0:14388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fae50feaa00/0xc86deac20833889e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc86deac208338897 expref: 16 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580183.605814:0:14388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fae50feaa00/0xc86deac20833889e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac208338897 expref: 16 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580183.605825:0:14388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae50feaa00, rc 0) 00000100:00100000:0.0:1787580183.605880:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae42b3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5949e638-96f6-489a-aea1-b9b80ed3224f+16:14393:x1874413262830464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580183.605886:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787580183.605942:0:14393:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae50729c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5949e638-96f6-489a-aea1-b9b80ed3224f:14393:1874413262830464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787580183.605967:0:14393:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff8fae4ca58000/0xc86deac208338897 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac20833889e expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580183.605976:0:14393:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff8fae4ca58000/0xc86deac208338897 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc86deac20833889e expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580183.606023:0:14393:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7e97e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5949e638-96f6-489a-aea1-b9b80ed3224f:14393:1874413262830592:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787580183.606059:0:14393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580183.606073:0:14393:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae5061b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787580183.606224:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262830592 00000100:00100000:1.0:1787580183.606229:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262830592 00000100:00100000:1.0:1787580183.606260:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787580183.606267:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae42b3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5949e638-96f6-489a-aea1-b9b80ed3224f+16:14393:x1874413262830592:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787580183.606283:0:14389:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787580183.606299:0:14389:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787580183.606303:0:14389:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1787580183.606379:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae42b3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5949e638-96f6-489a-aea1-b9b80ed3224f+16:14393:x1874413262830592:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 112us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580183.606406:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787580183.606542:0:14393:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7e97e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5949e638-96f6-489a-aea1-b9b80ed3224f:14393:1874413262830592:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787580183.606598:0:14393:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787580183.606605:0:14393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae4ca58000/0xc86deac208338897 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac20833889e expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580183.606615:0:14393:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff8fae4ca58000/0xc86deac208338897 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac20833889e expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580183.795835:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787580184.819675:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787580185.843599:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787580186.869935:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787580187.774341:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787580187.774349:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787580187.774352:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787580187.774356:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787580187.774812:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787580187.774834:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5072b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5949e638-96f6-489a-aea1-b9b80ed3224f:3316:1874413262830720:0@lo:400:kworker.0 00000100:00100000:3.0:1787580187.774939:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787580187.775186:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5072bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874413262830848:0@lo:400:kworker.0 00000100:00100000:1.0:1787580187.775222:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787580187.775246:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787580187.775268:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5072a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874413262830976:0@lo:400:kworker.0 00000100:00100000:1.0:1787580187.775296:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787580187.775602:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262830848 00000100:00100000:1.0:1787580187.775612:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262830848 00000100:00100000:1.0:1787580187.775659:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262830976 00000100:00100000:1.0:1787580187.775662:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262830976 00000100:00100000:1.0:1787580187.775707:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787580187.775715:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae50728700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874413262830848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787580187.775768:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae50728700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874413262830848:12345-0@lo:400:kworker.0 Request processed in 53us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580187.775775:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787580187.775792:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787580187.775798:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae50729880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874413262830976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787580187.775825:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae50729880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874413262830976:12345-0@lo:400:kworker.0 Request processed in 27us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580187.775831:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1787580187.776224:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fae5072a300 x1874413262830976/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787580203 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787580187.776242:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5072a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874413262830976:0@lo:400:kworker.0 00010000:00080000:1.0:1787580187.776255:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fae5072bb80 x1874413262830848/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787580203 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787580187.776264:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5072bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874413262830848:0@lo:400:kworker.0 00000100:00080000:3.0:1787580187.777900:0:14391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787580187.778267:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262830720 00000100:00100000:0.0:1787580187.778281:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262830720 00000100:00100000:0.0:1787580187.778344:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787580187.778354:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae42b3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5949e638-96f6-489a-aea1-b9b80ed3224f+16:3316:x1874413262830720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787580187.778495:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae42b3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5949e638-96f6-489a-aea1-b9b80ed3224f+16:3316:x1874413262830720:12345-0@lo:400:kworker.0 Request processed in 143us (3556us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580187.778504:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787580187.782896:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5072b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5949e638-96f6-489a-aea1-b9b80ed3224f:3316:1874413262830720:0@lo:400:kworker.0 00010000:00010000:1.0:1787580187.893523:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787580188.341472:0:14427:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787580188.919339:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787580189.944641:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787580190.639156:0:15446:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg236-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787580190.969454:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787580191.995593:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787580192.758037:0:3313:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787580177/real 1787580177] req@ffff8fae507bad80 x1874413262826496/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787580192 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787580192.758071:0:3313:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8fae507bad80 x1874413262826496/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787580192 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787580192.758083:0:3313:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787580177/real 1787580177] req@ffff8fae507baa00 x1874413262826624/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787580192 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787580192.758095:0:3313:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8fae507baa00 x1874413262826624/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787580192 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787580192.758120:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8fae6a23d000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787580192.758148:0:3313:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787580192.758153:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae507bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1874413262826496:0@lo:8:kworker.0 00000100:00080000:0.0:1787580192.758161:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8fae7f61c000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787580192.758167:0:3313:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787580192.758170:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae507baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1874413262826624:0@lo:8:kworker.0 00000100:00080000:3.0:1787580192.758433:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787580192.758438:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787580192.758441:0:36:0:(import.c:65:import_set_state_nolock()) ffff8fae6a23d000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787580192.758447:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 524 00000100:00080000:3.0:1787580192.758452:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787580192.758460:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8fae6a23d000 using connection 192.168.202.136@tcp/0@lo 00000100:00100000:3.0:1787580192.758487:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fae507bb100 x1874413262831232/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787580192.758499:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787580192.758503:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787580192.758521:0:36:0:(import.c:65:import_set_state_nolock()) ffff8fae7f61c000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787580192.758525:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 524 00000100:00080000:3.0:1787580192.758528:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787580192.758532:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8fae7f61c000 using connection 192.168.202.136@tcp/0@lo 00000100:00100000:3.0:1787580192.758546:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fae507bb800 x1874413262831360/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787580192.758599:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae507b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874413262831616:0@lo:400:kworker.0 00000100:00100000:3.0:1787580192.758687:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580192.758768:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262831616 00000100:00100000:3.0:1787580192.758777:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262831616 00000100:00100000:3.0:1787580192.758846:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787580192.758855:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae507b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874413262831616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787580192.758918:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae507b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874413262831616:12345-0@lo:400:kworker.0 Request processed in 63us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580192.758926:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1787580192.758945:0:14391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787580192.758970:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fae507b8e00 x1874413262831616/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787580208 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787580192.758982:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae507b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874413262831616:0@lo:400:kworker.0 00000100:00100000:2.0:1787580192.759930:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae507ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874413262831488:0@lo:400:kworker.0 00000100:00100000:2.0:1787580192.759979:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787580192.760023:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787580192.760030:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae507b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5949e638-96f6-489a-aea1-b9b80ed3224f:3317:1874413262831104:0@lo:400:kworker.0 00000100:00100000:2.0:1787580192.760058:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580192.761332:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262831104 00000100:00100000:0.0:1787580192.761348:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262831104 00000100:00100000:0.0:1787580192.761438:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787580192.761448:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7f765450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5949e638-96f6-489a-aea1-b9b80ed3224f+16:3317:x1874413262831104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787580192.761530:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7f765450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5949e638-96f6-489a-aea1-b9b80ed3224f+16:3317:x1874413262831104:12345-0@lo:400:kworker.0 Request processed in 83us (1470us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580192.761538:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787580192.761592:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae507b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5949e638-96f6-489a-aea1-b9b80ed3224f:3317:1874413262831104:0@lo:400:kworker.0 00000100:00100000:0.0:1787580192.761632:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae507bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1874413262831232:0@lo:8:kworker.0 00000100:00100000:0.0:1787580192.761682:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580192.762151:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae507bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1874413262831360:0@lo:8:kworker.0 00000100:00100000:0.0:1787580192.762183:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580192.762428:0:15103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262831488 00000100:00100000:3.0:1787580192.762435:0:15103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262831488 00000100:00100000:3.0:1787580192.762467:0:15103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787580192.762475:0:15103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d5b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874413262831488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787580192.762521:0:15103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d5b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1874413262831488:12345-0@lo:400:kworker.0 Request processed in 47us (2541us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580192.762527:0:15103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787580192.762673:0:15078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262831232 00000100:00100000:2.0:1787580192.762677:0:15078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262831232 00000100:00100000:2.0:1787580192.762710:0:15078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262831360 00000100:00100000:2.0:1787580192.762714:0:15078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262831360 00000100:00100000:2.0:1787580192.762724:0:15078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787580192.762730:0:15078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7e97e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3313:x1874413262831232:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1787580192.762754:0:15078:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 540 last 0 00000020:00000080:2.0:1787580192.762790:0:15078:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc86deac2083388a5 00002000:00100000:2.0:1787580192.762968:0:15078:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8fae746bd000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113950 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1787580192.762973:0:15078:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1787580192.762976:0:15078:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787580192.763345:0:15078:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787580192.763428:0:15078:0:(import.c:65:import_set_state_nolock()) ffff8fae746b8000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787580192.763487:0:15078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7e97e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3313:x1874413262831232:12345-0@lo:8:kworker.0 Request processed in 755us (1803us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580192.763496:0:15078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787580192.763515:0:15078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787580192.763520:0:15078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7e97c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3313:x1874413262831360:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1787580192.763532:0:15078:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787580192.763558:0:15078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7e97c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3313:x1874413262831360:12345-0@lo:8:kworker.0 Request processed in 37us (1374us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787580192.763565:0:15078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787580192.765864:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fae507ba300 x1874413262831488/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787580208 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787580192.765895:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae507ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3317:1874413262831488:0@lo:400:kworker.0 00010000:00080000:0.0:1787580192.765942:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fae507bb100 x1874413262831232/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787580212 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787580192.765951:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787580192.765959:0:3313:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1787580192.765968:0:3313:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787580192.765973:0:3313:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1787580192.765976:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8fae6a23d000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787580192.766004:0:3313:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787580192.766009:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae507bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1874413262831232:0@lo:8:kworker.0 00000100:00080000:0.0:1787580192.766023:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8fae7f61c000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787580192.766027:0:3313:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787580192.766029:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae507bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1874413262831360:0@lo:8:kworker.0 00000004:00080000:3.0:1787580192.766164:0:14417:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787580192.766689:0:14417:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 540522304975ns, next at 0ns, rc = 0 00000004:00080000:2.0:1787580192.767178:0:14418:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:2.0:1787580192.767203:0:14418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d5bad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14418:1874413262831872:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1787580192.767266:0:14418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787580192.767293:0:14418:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae45fc2e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787580192.767312:0:15078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262831872 00000100:00100000:2.0:1787580192.767318:0:15078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262831872 00000100:00100000:2.0:1787580192.767403:0:15078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787580192.767414:0:15078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d5b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14418:x1874413262831872:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:3.0:1787580192.768033:0:14391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787580192.768045:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787580192.768062:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d5b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874413262831744:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787580192.768115:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787580192.771369:0:15082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262831744 00000100:00100000:1.0:1787580192.771427:0:15082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262831744 00000100:00100000:1.0:1787580192.771487:0:15082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787580192.771499:0:15082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae507b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1874413262831744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787580192.771540:0:15082:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00010000:00080000:3.0:1787580192.774590:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fae6d5b8700 x1874413262831744/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787580208 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787580192.774620:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d5b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874413262831744:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787580192.775200:0:15082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae507b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1874413262831744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (3510us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580192.775214:0:15082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00002000:00080000:2.0:1787580192.795108:0:15078:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1787580192.795120:0:15078:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:2.0:1787580192.795126:0:15078:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00002000:00010000:2.0:1787580192.823000:0:15078:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787580192.823015:0:15078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa9f1a01/0xc86deac2083388ac lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.823032:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=540s v=(0 0) 00010000:00010000:2.0:1787580192.823044:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787580192.823051:0:15078:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9f1a01/0xc86deac2083388ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.823071:0:15078:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa9f1a01/0xc86deac2083388ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.823082:0:15078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa9f1a01/0xc86deac2083388ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.823089:0:15078:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa9f1a01/0xc86deac2083388ac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.823115:0:15078:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787580192.826369:0:15078:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787580192.826560:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787580192.826572:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa9f1a01/0xc86deac2083388ac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580192.826585:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db9c00 already unused, calling callback (ffffffffc155a230) 00010000:00010000:0.0:1787580192.826595:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa9f1a01/0xc86deac2083388ac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580192.826605:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa9f1a01/0xc86deac2083388ac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580192.826642:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa9f1a01/0xc86deac2083388ac lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580192.826651:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa9f1a01/0xc86deac2083388ac lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580192.826671:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787580192.826672:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787580192.826674:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787580192.827049:0:15078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000bac4bc3/0xc86deac2083388b3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.827062:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=540s v=(0 0) 00010000:00010000:2.0:1787580192.827066:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787580192.827073:0:15078:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000bac4bc3/0xc86deac2083388b3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.827085:0:15078:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000bac4bc3/0xc86deac2083388b3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.827093:0:15078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000bac4bc3/0xc86deac2083388b3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.827108:0:15078:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000bac4bc3/0xc86deac2083388b3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.827124:0:15078:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787580192.827925:0:15078:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787580192.827933:0:15078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df82ab54/0xc86deac2083388ba lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.827943:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=540s v=(0 0) 00010000:00010000:2.0:1787580192.827946:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787580192.827950:0:15078:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df82ab54/0xc86deac2083388ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.828028:0:15078:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df82ab54/0xc86deac2083388ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.828037:0:15078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df82ab54/0xc86deac2083388ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.828043:0:15078:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df82ab54/0xc86deac2083388ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.828061:0:15078:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787580192.828070:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787580192.828076:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000bac4bc3/0xc86deac2083388b3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.828089:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db8000 already unused, calling callback (ffffffffc155a230) 00010000:00010000:2.0:1787580192.828094:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000bac4bc3/0xc86deac2083388b3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.828102:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000bac4bc3/0xc86deac2083388b3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.828116:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000bac4bc3/0xc86deac2083388b3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.828123:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000bac4bc3/0xc86deac2083388b3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.828137:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787580192.828139:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df82ab54/0xc86deac2083388ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.828145:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db9800 already unused, calling callback (ffffffffc155a230) 00010000:00010000:2.0:1787580192.828148:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df82ab54/0xc86deac2083388ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.828154:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df82ab54/0xc86deac2083388ba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.828163:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df82ab54/0xc86deac2083388ba lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.828175:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df82ab54/0xc86deac2083388ba lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.828187:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787580192.828189:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787580192.828191:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787580192.830099:0:15078:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787580192.830113:0:15078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6b004f7/0xc86deac2083388c1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.830128:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=540s v=(0 0) 00010000:00010000:2.0:1787580192.830133:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787580192.830139:0:15078:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6b004f7/0xc86deac2083388c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.830151:0:15078:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6b004f7/0xc86deac2083388c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.830160:0:15078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6b004f7/0xc86deac2083388c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.830167:0:15078:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6b004f7/0xc86deac2083388c1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.830193:0:15078:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787580192.831328:0:14383:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787580192.831342:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6b004f7/0xc86deac2083388c1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580192.831365:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db8800 already unused, calling callback (ffffffffc155a230) 00010000:00010000:0.0:1787580192.831371:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6b004f7/0xc86deac2083388c1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580192.831399:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6b004f7/0xc86deac2083388c1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580192.831427:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6b004f7/0xc86deac2083388c1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580192.831444:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6b004f7/0xc86deac2083388c1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580192.831468:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787580192.831470:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787580192.831472:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787580192.831908:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787580192.832058:0:15078:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787580192.832074:0:15078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a08b1d28/0xc86deac2083388c8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.832086:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=540s v=(0 0) 00010000:00010000:2.0:1787580192.832091:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787580192.832097:0:15078:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a08b1d28/0xc86deac2083388c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.832108:0:15078:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a08b1d28/0xc86deac2083388c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.832118:0:15078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a08b1d28/0xc86deac2083388c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.832125:0:15078:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a08b1d28/0xc86deac2083388c8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.832149:0:15078:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787580192.833183:0:15078:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787580192.833191:0:15078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ed6f3eb/0xc86deac2083388cf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.833202:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=540s v=(0 0) 00010000:00010000:2.0:1787580192.833206:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787580192.833210:0:15078:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ed6f3eb/0xc86deac2083388cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.833220:0:15078:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006ed6f3eb/0xc86deac2083388cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.833234:0:15078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ed6f3eb/0xc86deac2083388cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.833241:0:15078:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006ed6f3eb/0xc86deac2083388cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.833261:0:15078:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787580192.833274:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787580192.833279:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a08b1d28/0xc86deac2083388c8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.833285:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db8400 already unused, calling callback (ffffffffc155a230) 00010000:00010000:2.0:1787580192.833289:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a08b1d28/0xc86deac2083388c8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.833297:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a08b1d28/0xc86deac2083388c8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.833311:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a08b1d28/0xc86deac2083388c8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.833318:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a08b1d28/0xc86deac2083388c8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.833333:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787580192.833341:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006ed6f3eb/0xc86deac2083388cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.833348:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db8600 already unused, calling callback (ffffffffc155a230) 00010000:00010000:2.0:1787580192.833351:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006ed6f3eb/0xc86deac2083388cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.833373:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006ed6f3eb/0xc86deac2083388cf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.833547:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006ed6f3eb/0xc86deac2083388cf lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.833554:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006ed6f3eb/0xc86deac2083388cf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.833567:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787580192.833569:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787580192.833570:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787580192.834792:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787580192.835325:0:15078:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787580192.835334:0:15078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fbc6d3f5/0xc86deac2083388d6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.835348:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=540s v=(0 0) 00010000:00010000:2.0:1787580192.835352:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787580192.835358:0:15078:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fbc6d3f5/0xc86deac2083388d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.835401:0:15078:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fbc6d3f5/0xc86deac2083388d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.835411:0:15078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fbc6d3f5/0xc86deac2083388d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.835420:0:15078:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fbc6d3f5/0xc86deac2083388d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.835438:0:15078:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787580192.835491:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787580192.835497:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fbc6d3f5/0xc86deac2083388d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580192.835506:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db9e00 already unused, calling callback (ffffffffc155a230) 00010000:00010000:3.0:1787580192.835510:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fbc6d3f5/0xc86deac2083388d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580192.835518:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fbc6d3f5/0xc86deac2083388d6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580192.835535:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fbc6d3f5/0xc86deac2083388d6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580192.835543:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fbc6d3f5/0xc86deac2083388d6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580192.835570:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787580192.835572:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787580192.835574:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787580192.836310:0:15078:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787580192.836319:0:15078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1b30e7e/0xc86deac2083388dd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.836330:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=540s v=(0 0) 00010000:00010000:2.0:1787580192.836333:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787580192.836338:0:15078:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1b30e7e/0xc86deac2083388dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.836347:0:15078:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1b30e7e/0xc86deac2083388dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.836481:0:15078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1b30e7e/0xc86deac2083388dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.836502:0:15078:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1b30e7e/0xc86deac2083388dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.836518:0:15078:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787580192.836908:0:14383:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787580192.836915:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1b30e7e/0xc86deac2083388dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580192.836923:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db9600 already unused, calling callback (ffffffffc155a230) 00010000:00010000:0.0:1787580192.836928:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1b30e7e/0xc86deac2083388dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580192.836935:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1b30e7e/0xc86deac2083388dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580192.836952:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1b30e7e/0xc86deac2083388dd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580192.836959:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1b30e7e/0xc86deac2083388dd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580192.836978:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787580192.836979:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787580192.836981:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787580192.838315:0:15078:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787580192.838325:0:15078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001bd9f46a/0xc86deac2083388e4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.838340:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=540s v=(0 0) 00010000:00010000:2.0:1787580192.838344:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787580192.838349:0:15078:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001bd9f46a/0xc86deac2083388e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.838507:0:15078:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001bd9f46a/0xc86deac2083388e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.838516:0:15078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001bd9f46a/0xc86deac2083388e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.838524:0:15078:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001bd9f46a/0xc86deac2083388e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.838558:0:15078:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787580192.838823:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787580192.838830:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001bd9f46a/0xc86deac2083388e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580192.838839:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db8e00 already unused, calling callback (ffffffffc155a230) 00010000:00010000:0.0:1787580192.838843:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001bd9f46a/0xc86deac2083388e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580192.838852:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001bd9f46a/0xc86deac2083388e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580192.838866:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001bd9f46a/0xc86deac2083388e4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580192.838884:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001bd9f46a/0xc86deac2083388e4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580192.838902:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787580192.838904:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787580192.838906:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787580192.839266:0:15078:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787580192.839273:0:15078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5ee058b/0xc86deac2083388eb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.839290:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=540s v=(0 0) 00010000:00010000:2.0:1787580192.839292:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787580192.839296:0:15078:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5ee058b/0xc86deac2083388eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.839304:0:15078:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5ee058b/0xc86deac2083388eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.839312:0:15078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5ee058b/0xc86deac2083388eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.839319:0:15078:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5ee058b/0xc86deac2083388eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.839341:0:15078:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787580192.840246:0:15078:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787580192.840253:0:15078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8509fa6/0xc86deac2083388f2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.840261:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=540s v=(0 0) 00010000:00010000:2.0:1787580192.840264:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787580192.840269:0:15078:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e8509fa6/0xc86deac2083388f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.840277:0:15078:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e8509fa6/0xc86deac2083388f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.840293:0:15078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8509fa6/0xc86deac2083388f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.840300:0:15078:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e8509fa6/0xc86deac2083388f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.840322:0:15078:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787580192.840329:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787580192.840335:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5ee058b/0xc86deac2083388eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580192.840343:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db8a00 already unused, calling callback (ffffffffc155a230) 00010000:00010000:0.0:1787580192.840347:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5ee058b/0xc86deac2083388eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580192.840364:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5ee058b/0xc86deac2083388eb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580192.840377:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5ee058b/0xc86deac2083388eb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580192.840540:0:14383:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:2.0:1787580192.841147:0:15078:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787580192.841155:0:15078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000536e840b/0xc86deac2083388f9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.841165:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=540s v=(0 0) 00010000:00010000:2.0:1787580192.841168:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787580192.841173:0:15078:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000536e840b/0xc86deac2083388f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.841183:0:15078:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000536e840b/0xc86deac2083388f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.841191:0:15078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000536e840b/0xc86deac2083388f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.841198:0:15078:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000536e840b/0xc86deac2083388f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.841216:0:15078:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787580192.841943:0:15078:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787580192.841950:0:15078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d352871c/0xc86deac208338900 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.842175:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=540s v=(0 0) 00010000:00010000:2.0:1787580192.842178:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787580192.842183:0:15078:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d352871c/0xc86deac208338900 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.842193:0:15078:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d352871c/0xc86deac208338900 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.842201:0:15078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d352871c/0xc86deac208338900 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.842207:0:15078:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d352871c/0xc86deac208338900 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.842216:0:15078:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787580192.843008:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5ee058b/0xc86deac2083388eb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580192.843036:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787580192.843040:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000536e840b/0xc86deac2083388f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580192.843047:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae74ed9a00 already unused, calling callback (ffffffffc155a230) 00010000:00010000:0.0:1787580192.843052:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000536e840b/0xc86deac2083388f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580192.843060:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000536e840b/0xc86deac2083388f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580192.843077:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000536e840b/0xc86deac2083388f9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580192.843085:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000536e840b/0xc86deac2083388f9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580192.843110:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787580192.843113:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d352871c/0xc86deac208338900 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580192.843119:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae74ed8c00 already unused, calling callback (ffffffffc155a230) 00010000:00010000:0.0:1787580192.843122:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d352871c/0xc86deac208338900 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580192.843129:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d352871c/0xc86deac208338900 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580192.843137:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d352871c/0xc86deac208338900 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787580192.843142:0:15078:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787580192.843144:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d352871c/0xc86deac208338900 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.843148:0:15078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e71b1797/0xc86deac208338907 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580192.843155:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787580192.843157:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=540s v=(0 0) 00010000:00010000:0.0:1787580192.843157:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787580192.843159:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787580192.843165:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787580192.843170:0:15078:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e71b1797/0xc86deac208338907 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.843179:0:15078:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e71b1797/0xc86deac208338907 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.843187:0:15078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e71b1797/0xc86deac208338907 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.843195:0:15078:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e71b1797/0xc86deac208338907 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.843214:0:15078:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787580192.844069:0:15078:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787580192.844078:0:15078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000713e05c4/0xc86deac20833890e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.844090:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=540s v=(0 0) 00010000:00010000:2.0:1787580192.844093:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787580192.844098:0:15078:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000713e05c4/0xc86deac20833890e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.844108:0:15078:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000713e05c4/0xc86deac20833890e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.844116:0:15078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000713e05c4/0xc86deac20833890e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.844130:0:15078:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000713e05c4/0xc86deac20833890e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.844139:0:15078:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1787580192.844730:0:15078:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787580192.844738:0:15078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4c7c33e/0xc86deac208338915 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.844747:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=540s v=(0 0) 00010000:00010000:2.0:1787580192.844750:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787580192.844754:0:15078:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4c7c33e/0xc86deac208338915 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.844764:0:15078:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4c7c33e/0xc86deac208338915 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.844772:0:15078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4c7c33e/0xc86deac208338915 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.844780:0:15078:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4c7c33e/0xc86deac208338915 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.844789:0:15078:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1787580192.844978:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787580192.844985:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e71b1797/0xc86deac208338907 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580192.844993:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae74ed9000 already unused, calling callback (ffffffffc155a230) 00010000:00010000:0.0:1787580192.845005:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e71b1797/0xc86deac208338907 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580192.845015:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e71b1797/0xc86deac208338907 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580192.845030:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e71b1797/0xc86deac208338907 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580192.845039:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e71b1797/0xc86deac208338907 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580192.845057:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787580192.845061:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000713e05c4/0xc86deac20833890e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580192.845068:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae74ed8400 already unused, calling callback (ffffffffc155a230) 00010000:00010000:0.0:1787580192.845071:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000713e05c4/0xc86deac20833890e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580192.845078:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000713e05c4/0xc86deac20833890e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580192.845087:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000713e05c4/0xc86deac20833890e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580192.845094:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000713e05c4/0xc86deac20833890e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580192.845112:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787580192.845115:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4c7c33e/0xc86deac208338915 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580192.845122:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae74ed9800 already unused, calling callback (ffffffffc155a230) 00010000:00010000:0.0:1787580192.845125:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4c7c33e/0xc86deac208338915 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580192.845133:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4c7c33e/0xc86deac208338915 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580192.845143:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4c7c33e/0xc86deac208338915 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580192.845150:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4c7c33e/0xc86deac208338915 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580192.845161:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787580192.845163:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787580192.845165:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787580192.845422:0:15522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787580192.845431:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e8509fa6/0xc86deac2083388f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580192.845439:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae74ed8a00 already unused, calling callback (ffffffffc155a230) 00010000:00010000:3.0:1787580192.845442:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8509fa6/0xc86deac2083388f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580192.845450:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8509fa6/0xc86deac2083388f2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580192.845462:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e8509fa6/0xc86deac2083388f2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580192.845469:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e8509fa6/0xc86deac2083388f2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580192.845486:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787580192.845488:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787580192.845490:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787580192.845494:0:15522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787580192.845495:0:15522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787580192.845547:0:15078:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787580192.845552:0:15078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007243c783/0xc86deac20833891c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.845566:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=540s v=(0 0) 00010000:00010000:2.0:1787580192.845569:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787580192.845573:0:15078:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007243c783/0xc86deac20833891c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.845583:0:15078:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007243c783/0xc86deac20833891c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.845592:0:15078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007243c783/0xc86deac20833891c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.845599:0:15078:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007243c783/0xc86deac20833891c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.845622:0:15078:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787580192.845680:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787580192.845700:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007243c783/0xc86deac20833891c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580192.845709:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae74ed9400 already unused, calling callback (ffffffffc155a230) 00010000:00010000:3.0:1787580192.845712:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007243c783/0xc86deac20833891c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580192.845720:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007243c783/0xc86deac20833891c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580192.845731:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007243c783/0xc86deac20833891c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580192.845738:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007243c783/0xc86deac20833891c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580192.845749:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787580192.845751:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787580192.845753:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787580192.846233:0:15078:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787580192.846238:0:15078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4a73aae/0xc86deac208338923 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.846246:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=540s v=(0 0) 00010000:00010000:2.0:1787580192.846249:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787580192.846253:0:15078:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d4a73aae/0xc86deac208338923 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.846262:0:15078:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d4a73aae/0xc86deac208338923 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.846280:0:15078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4a73aae/0xc86deac208338923 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.846287:0:15078:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d4a73aae/0xc86deac208338923 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.846297:0:15078:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787580192.848547:0:14383:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787580192.848560:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d4a73aae/0xc86deac208338923 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580192.848572:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae74ed8e00 already unused, calling callback (ffffffffc155a230) 00010000:00010000:3.0:1787580192.848576:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4a73aae/0xc86deac208338923 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580192.848598:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4a73aae/0xc86deac208338923 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580192.848618:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d4a73aae/0xc86deac208338923 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580192.848625:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d4a73aae/0xc86deac208338923 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580192.848643:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787580192.848645:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787580192.848647:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787580192.848880:0:15078:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787580192.848888:0:15078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000273dae0e/0xc86deac20833892a lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.848900:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=540s v=(0 0) 00010000:00010000:2.0:1787580192.848904:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787580192.848910:0:15078:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000273dae0e/0xc86deac20833892a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.848921:0:15078:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000273dae0e/0xc86deac20833892a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.848929:0:15078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000273dae0e/0xc86deac20833892a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.848937:0:15078:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000273dae0e/0xc86deac20833892a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.849029:0:15078:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787580192.849760:0:15078:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787580192.849767:0:15078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078f1dcef/0xc86deac208338931 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.849776:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=540s v=(0 0) 00010000:00010000:2.0:1787580192.849780:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787580192.849784:0:15078:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078f1dcef/0xc86deac208338931 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.849856:0:15078:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078f1dcef/0xc86deac208338931 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.849866:0:15078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078f1dcef/0xc86deac208338931 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.849883:0:15078:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078f1dcef/0xc86deac208338931 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.849906:0:15078:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787580192.850095:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787580192.850103:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000273dae0e/0xc86deac20833892a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580192.850111:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae74ed8200 already unused, calling callback (ffffffffc155a230) 00010000:00010000:1.0:1787580192.850115:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000273dae0e/0xc86deac20833892a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580192.850125:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000273dae0e/0xc86deac20833892a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580192.850142:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000273dae0e/0xc86deac20833892a lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580192.850149:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000273dae0e/0xc86deac20833892a lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580192.850167:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787580192.850170:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078f1dcef/0xc86deac208338931 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580192.850183:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae74ed9600 already unused, calling callback (ffffffffc155a230) 00010000:00010000:1.0:1787580192.850186:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078f1dcef/0xc86deac208338931 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580192.850193:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078f1dcef/0xc86deac208338931 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580192.850203:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078f1dcef/0xc86deac208338931 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580192.850209:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078f1dcef/0xc86deac208338931 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580192.850220:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787580192.850221:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787580192.850223:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787580192.850511:0:15078:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787580192.850517:0:15078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a2386e5/0xc86deac208338938 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.850526:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=540s v=(0 0) 00010000:00010000:2.0:1787580192.850535:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787580192.850540:0:15078:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a2386e5/0xc86deac208338938 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.850549:0:15078:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a2386e5/0xc86deac208338938 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.850558:0:15078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a2386e5/0xc86deac208338938 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.850565:0:15078:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a2386e5/0xc86deac208338938 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.850585:0:15078:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787580192.850602:0:14383:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787580192.850610:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a2386e5/0xc86deac208338938 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580192.850618:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae74ed9200 already unused, calling callback (ffffffffc155a230) 00010000:00010000:0.0:1787580192.850638:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a2386e5/0xc86deac208338938 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580192.850647:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a2386e5/0xc86deac208338938 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580192.850659:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a2386e5/0xc86deac208338938 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580192.850665:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a2386e5/0xc86deac208338938 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580192.850678:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787580192.850680:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787580192.850682:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787580192.851223:0:15078:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787580192.851230:0:15078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b73db36/0xc86deac20833893f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.851240:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=540s v=(0 0) 00010000:00010000:2.0:1787580192.851243:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787580192.851247:0:15078:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b73db36/0xc86deac20833893f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.851255:0:15078:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005b73db36/0xc86deac20833893f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.851263:0:15078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b73db36/0xc86deac20833893f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.851276:0:15078:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005b73db36/0xc86deac20833893f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.851297:0:15078:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787580192.852121:0:15078:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787580192.852129:0:15078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c7932be/0xc86deac208338946 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.852139:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=540s v=(0 0) 00010000:00010000:2.0:1787580192.852143:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787580192.852147:0:15078:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c7932be/0xc86deac208338946 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.852156:0:15078:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c7932be/0xc86deac208338946 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.852165:0:15078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c7932be/0xc86deac208338946 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.852173:0:15078:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009c7932be/0xc86deac208338946 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.852197:0:15078:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787580192.852886:0:14383:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787580192.852895:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005b73db36/0xc86deac20833893f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580192.852905:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae74ed8800 already unused, calling callback (ffffffffc155a230) 00010000:00010000:0.0:1787580192.852909:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005b73db36/0xc86deac20833893f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580192.852919:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005b73db36/0xc86deac20833893f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580192.852937:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005b73db36/0xc86deac20833893f lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580192.852951:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b73db36/0xc86deac20833893f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580192.852972:0:14383:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787580192.852976:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009c7932be/0xc86deac208338946 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580192.852983:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae74ed9e00 already unused, calling callback (ffffffffc155a230) 00010000:00010000:0.0:1787580192.852986:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009c7932be/0xc86deac208338946 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580192.852993:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009c7932be/0xc86deac208338946 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580192.853004:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009c7932be/0xc86deac208338946 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580192.853011:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c7932be/0xc86deac208338946 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580192.853023:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787580192.853025:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787580192.853027:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787580192.853286:0:15078:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787580192.853293:0:15078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036db935a/0xc86deac20833894d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.853305:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=540s v=(0 0) 00010000:00010000:2.0:1787580192.853309:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787580192.853313:0:15078:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036db935a/0xc86deac20833894d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.853323:0:15078:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036db935a/0xc86deac20833894d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.853331:0:15078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036db935a/0xc86deac20833894d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.853477:0:15078:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000036db935a/0xc86deac20833894d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.853497:0:15078:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787580192.853504:0:14383:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787580192.853509:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000036db935a/0xc86deac20833894d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580192.853522:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae74ed8600 already unused, calling callback (ffffffffc155a230) 00010000:00010000:0.0:1787580192.853526:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000036db935a/0xc86deac20833894d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580192.853534:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000036db935a/0xc86deac20833894d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580192.853545:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000036db935a/0xc86deac20833894d lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580192.853552:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036db935a/0xc86deac20833894d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580192.853565:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787580192.853567:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787580192.853568:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787580192.854187:0:15078:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787580192.854194:0:15078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2dec73e/0xc86deac208338954 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.854205:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=540s v=(0 0) 00010000:00010000:2.0:1787580192.854208:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787580192.854213:0:15078:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2dec73e/0xc86deac208338954 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.854222:0:15078:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2dec73e/0xc86deac208338954 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.854240:0:15078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2dec73e/0xc86deac208338954 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.854248:0:15078:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a2dec73e/0xc86deac208338954 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.854270:0:15078:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787580192.854282:0:14383:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787580192.854287:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a2dec73e/0xc86deac208338954 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580192.854295:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae74ed9c00 already unused, calling callback (ffffffffc155a230) 00010000:00010000:0.0:1787580192.854298:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2dec73e/0xc86deac208338954 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580192.854307:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2dec73e/0xc86deac208338954 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580192.854322:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a2dec73e/0xc86deac208338954 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580192.854330:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2dec73e/0xc86deac208338954 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580192.854343:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787580192.854346:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787580192.854347:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787580192.855220:0:15078:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787580192.855229:0:15078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000919b4d90/0xc86deac20833895b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.855239:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=540s v=(0 0) 00010000:00010000:2.0:1787580192.855242:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787580192.855247:0:15078:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000919b4d90/0xc86deac20833895b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.855257:0:15078:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000919b4d90/0xc86deac20833895b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.855265:0:15078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000919b4d90/0xc86deac20833895b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.855273:0:15078:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000919b4d90/0xc86deac20833895b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.855311:0:15078:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787580192.855326:0:14383:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787580192.855331:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000919b4d90/0xc86deac20833895b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580192.855339:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae74ed8000 already unused, calling callback (ffffffffc155a230) 00010000:00010000:0.0:1787580192.855343:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000919b4d90/0xc86deac20833895b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580192.855351:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000919b4d90/0xc86deac20833895b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580192.855364:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000919b4d90/0xc86deac20833895b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580192.855371:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000919b4d90/0xc86deac20833895b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580192.855424:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787580192.855426:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787580192.855427:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787580192.856307:0:15078:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787580192.856314:0:15078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004319820c/0xc86deac208338962 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.856326:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=540s v=(0 0) 00010000:00010000:2.0:1787580192.856330:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787580192.856335:0:15078:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004319820c/0xc86deac208338962 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.856345:0:15078:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004319820c/0xc86deac208338962 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.856507:0:15078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004319820c/0xc86deac208338962 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.856518:0:15078:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004319820c/0xc86deac208338962 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.856543:0:15078:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787580192.856553:0:14383:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787580192.856560:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004319820c/0xc86deac208338962 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580192.856568:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae6dfb7600 already unused, calling callback (ffffffffc155a230) 00010000:00010000:0.0:1787580192.856573:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004319820c/0xc86deac208338962 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580192.856581:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004319820c/0xc86deac208338962 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580192.856594:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004319820c/0xc86deac208338962 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580192.856602:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004319820c/0xc86deac208338962 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580192.856620:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787580192.856622:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787580192.856623:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787580192.856943:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787580192.857431:0:15522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787580192.857519:0:15078:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787580192.857529:0:15078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da2fce3a/0xc86deac208338969 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.857541:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=540s v=(0 0) 00010000:00010000:2.0:1787580192.857551:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787580192.857556:0:15078:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da2fce3a/0xc86deac208338969 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.857581:0:15078:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da2fce3a/0xc86deac208338969 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.857591:0:15078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da2fce3a/0xc86deac208338969 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.857599:0:15078:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da2fce3a/0xc86deac208338969 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580192.857860:0:15078:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787580192.857909:0:14383:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787580192.857916:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da2fce3a/0xc86deac208338969 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580192.857924:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae6dfb7c00 already unused, calling callback (ffffffffc155a230) 00010000:00010000:3.0:1787580192.857928:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da2fce3a/0xc86deac208338969 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580192.857937:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da2fce3a/0xc86deac208338969 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580192.857951:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da2fce3a/0xc86deac208338969 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580192.857965:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da2fce3a/0xc86deac208338969 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580192.857984:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787580192.857986:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787580192.857988:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1787580192.858146:0:15078:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:2.0:1787580192.858275:0:15078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d5b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14418:x1874413262831872:12345-0@lo:5:osp-pre-0-0.0 Request processed in 90859us (91003us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580192.858285:0:15078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787580192.858474:0:14418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d5bad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14418:1874413262831872:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1787580192.858494:0:14418:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:2.0:1787580192.858571:0:14418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d5b8a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14418:1874413262832000:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1787580192.858610:0:14418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580192.858715:0:15080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262832000 00000100:00100000:3.0:1787580192.858722:0:15080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262832000 00000100:00100000:3.0:1787580192.858765:0:15080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787580192.858776:0:15080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d5b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14418:x1874413262832000:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1787580192.858817:0:15080:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:2.0:1787580192.858915:0:14418:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae45fc29c0 going to sleep for 11 seconds 00000004:00080000:1.0:1787580192.865492:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:2.0:1787580192.867305:0:15080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d5b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14418:x1874413262832000:12345-0@lo:5:osp-pre-0-0.0 Request processed in 8523us (8687us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1787580192.867319:0:15080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787580192.869601:0:14418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d5b8a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14418:1874413262832000:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1787580192.869621:0:14418:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:3.0:1787580193.013485:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787580193.013511:0:6733:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:3.0:1787580193.013563:0:6733:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1787580194.036572:0:15522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787580195.065624:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787580196.089990:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787580197.108727:0:15522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787580198.003617:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787580198.003626:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787580198.003631:0:36:0:(import.c:65:import_set_state_nolock()) ffff8fae7f61c000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787580198.003641:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 540 00000100:00080000:1.0:1787580198.003658:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1787580198.003668:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8fae7f61c000 using connection 192.168.202.136@tcp/0@lo 00000100:00100000:1.0:1787580198.003692:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fae50728a80 x1874413262832384/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787580198.004045:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae50729180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874413262832512:0@lo:400:kworker.0 00000100:00100000:3.0:1787580198.004118:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580198.004191:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787580198.004198:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5072b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874413262832640:0@lo:400:kworker.0 00000100:00100000:3.0:1787580198.004844:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580198.004902:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262832512 00000100:00100000:3.0:1787580198.004911:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262832512 00000100:00100000:3.0:1787580198.004966:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262832640 00000100:00100000:3.0:1787580198.004970:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262832640 00000100:00100000:3.0:1787580198.005007:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787580198.005030:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae507b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874413262832512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787580198.005077:0:15103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787580198.005088:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae507b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874413262832512:12345-0@lo:400:kworker.0 Request processed in 59us (969us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580198.005090:0:15103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae507ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874413262832640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787580198.005100:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1787580198.005128:0:14391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787580198.005144:0:15103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae507ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874413262832640:12345-0@lo:400:kworker.0 Request processed in 57us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580198.005161:0:15103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1787580198.005168:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fae5072b480 x1874413262832640/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787580214 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787580198.005183:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5072b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874413262832640:0@lo:400:kworker.0 00010000:00080000:3.0:1787580198.005194:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fae50729180 x1874413262832512/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787580214 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787580198.005202:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae50729180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874413262832512:0@lo:400:kworker.0 00000100:00100000:0.0:1787580198.005477:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5072bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5949e638-96f6-489a-aea1-b9b80ed3224f:3316:1874413262832128:0@lo:400:kworker.0 00000100:00100000:0.0:1787580198.005515:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580198.005558:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7e97c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262832768:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787580198.005582:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580198.005601:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787580198.005608:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5072a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262832256:0@lo:400:kworker.0 00000100:00100000:0.0:1787580198.005630:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580198.005688:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae50728a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1874413262832384:0@lo:8:kworker.0 00000100:00100000:0.0:1787580198.005709:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580198.005747:0:15083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262832768 00000100:00100000:0.0:1787580198.005751:0:15083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262832768 00000100:00100000:0.0:1787580198.005780:0:15083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787580198.005786:0:15083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7e97f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262832768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787580198.005812:0:15083:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787580198.005860:0:15083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7e97f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262832768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580198.005867:0:15083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1787580198.006161:0:14391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787580198.006186:0:3316:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1787580198.006204:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7e97c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262832768:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787580198.006674:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262832128 00000100:00100000:3.0:1787580198.006685:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262832128 00000100:00100000:3.0:1787580198.006718:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787580198.006725:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7f764c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5949e638-96f6-489a-aea1-b9b80ed3224f+16:3316:x1874413262832128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787580198.006770:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7f764c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5949e638-96f6-489a-aea1-b9b80ed3224f+16:3316:x1874413262832128:12345-0@lo:400:kworker.0 Request processed in 46us (1255us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580198.006776:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787580198.006814:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5072bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5949e638-96f6-489a-aea1-b9b80ed3224f:3316:1874413262832128:0@lo:400:kworker.0 00000100:00100000:2.0:1787580198.007569:0:15078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262832256 00000100:00100000:2.0:1787580198.007577:0:15078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262832256 00000100:00100000:2.0:1787580198.007797:0:15078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262832384 00000100:00100000:2.0:1787580198.007801:0:15078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262832384 00000100:00100000:2.0:1787580198.007816:0:15078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787580198.007834:0:15078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7e97ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262832256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787580198.007898:0:15078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7e97ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262832256:12345-0@lo:400:kworker.0 Request processed in 75us (2266us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580198.007906:0:15078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787580198.007919:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5072a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262832256:0@lo:400:kworker.0 00000100:00100000:2.0:1787580198.007925:0:15078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787580198.007932:0:15078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7e97c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3313:x1874413262832384:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1787580198.007951:0:15078:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787580198.028549:0:15078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7e97c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3313:x1874413262832384:12345-0@lo:8:kworker.0 Request processed in 20608us (22830us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787580198.028563:0:15078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1787580198.028737:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8fae7f61c000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787580198.028742:0:3313:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787580198.028752:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae50728a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1874413262832384:0@lo:8:kworker.0 00010000:00010000:3.0:1787580198.131804:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787580198.236244:0:15799:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787580198.236248:0:15799:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1787580198.236433:0:15799:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8fae746bf000 00000020:01000004:2.0:1787580198.236450:0:15799:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1787580198.236463:0:15799:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1787580198.236477:0:15799:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8fad42a8cd28) 00000020:00000080:2.0:1787580198.236495:0:15799:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787580198.266014:0:15799:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787580198.266272:0:15799:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1787580198.266896:0:15799:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787580198.267080:0:15799:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1787580198.267428:0:15799:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1787580198.267690:0:15799:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 229: rc = 0 00100000:10000000:3.0:1787580198.267767:0:15799:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 229: rc = 0 00100000:10000000:3.0:1787580198.267838:0:15799:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 229: rc = 0 00100000:10000000:3.0:1787580198.271733:0:15799:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 756: rc = 0 00100000:10000000:3.0:1787580198.272084:0:15799:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 756: rc = 0 00100000:10000000:3.0:1787580198.272460:0:15799:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 756: rc = 0 00100000:10000000:3.0:1787580198.272700:0:15799:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 756: rc = 0 00100000:10000000:3.0:1787580198.272951:0:15799:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 756: rc = 0 00100000:10000000:3.0:1787580198.273212:0:15799:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 756: rc = 0 00000020:00000080:3.0:1787580198.273962:0:15799:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1787580198.273977:0:15799:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787580198.273988:0:15799:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc86deac208338977 00000020:01000004:3.0:1787580198.273998:0:15799:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1787580198.274024:0:15799:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.136@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787580198.274028:0:15799:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.136@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787580198.274034:0:15799:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1787580198.274061:0:15799:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1787580198.274067:0:15799:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.136@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1787580198.298045:0:15799:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.136@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787580198.298094:0:15799:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.136@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1787580198.298099:0:15799:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787580198.298101:0:15799:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787580198.298102:0:15799:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787580198.298109:0:15799:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787580198.298110:0:15799:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787580198.298111:0:15799:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787580198.298113:0:15799:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787580198.298114:0:15799:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787580198.298116:0:15799:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787580198.298120:0:15799:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1787580198.298122:0:15799:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787580198.298123:0:15799:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787580198.298124:0:15799:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787580198.298125:0:15799:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787580198.298126:0:15799:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787580198.298127:0:15799:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787580198.298128:0:15799:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787580198.298129:0:15799:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787580198.298130:0:15799:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787580198.298161:0:15799:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787580198.298183:0:15799:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d5bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:15799:1874413262832896:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787580198.298256:0:15799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787580198.298309:0:15799:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae50edacc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787580198.299035:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262832896 00000100:00100000:0.0:1787580198.299044:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262832896 00000100:00100000:0.0:1787580198.299116:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787580198.299126:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7f765c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5949e638-96f6-489a-aea1-b9b80ed3224f+16:15799:x1874413262832896:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787580198.299182:0:14390:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1787580198.299186:0:14390:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1787580198.299190:0:14390:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1787580198.316133:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7f765c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5949e638-96f6-489a-aea1-b9b80ed3224f+16:15799:x1874413262832896:12345-0@lo:253:mount.lustre.0 Request processed in 16994us (17862us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580198.316156:0:15799:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d5bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:15799:1874413262832896:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787580198.316177:0:15799:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787580198.316181:0:15799:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787580198.316183:0:15799:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787580198.316184:0:15799:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787580198.316185:0:15799:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787580198.316187:0:15799:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000100:00100000:0.0:1787580198.316299:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000020:01000004:2.0:1787580198.316472:0:15799:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787580198.316475:0:15799:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787580198.316476:0:15799:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787580198.316477:0:15799:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787580198.316496:0:15799:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8fae746bf000 from lustre-OST0001 10000000:01000000:2.0:1787580198.316517:0:15799:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1787580198.316520:0:15799:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787580198.316527:0:15799:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8fae6d5419b8 local copy 00010000:00010000:2.0:1787580198.316537:0:15799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae5f6d7e00/0xc86deac20833871d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208338724 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580198.316764:0:15799:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d5bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:15799:1874413262833024:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787580198.316801:0:15799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787580198.316846:0:15799:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae50edacc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787580198.316869:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262833024 00000100:00100000:0.0:1787580198.316878:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262833024 00000100:00100000:0.0:1787580198.316963:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787580198.316974:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7f766050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5949e638-96f6-489a-aea1-b9b80ed3224f+16:15799:x1874413262833024:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787580198.317270:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7f766050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5949e638-96f6-489a-aea1-b9b80ed3224f+16:15799:x1874413262833024:12345-0@lo:501:mount.lustre.0 Request processed in 296us (466us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787580198.317279:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787580198.317355:0:15799:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d5bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:15799:1874413262833024:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1787580198.317372:0:15799:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.136@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787580198.317550:0:15799:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.136@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787580198.317558:0:15799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae5f6d7e00/0xc86deac20833871d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208338724 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580198.317567:0:15799:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff8fae5f6d7e00/0xc86deac20833871d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208338724 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787580198.317591:0:15799:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8fae746bf000 10000000:01000000:2.0:1787580198.317596:0:15799:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787580198.317601:0:15799:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787580198.317604:0:15799:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787580198.317608:0:15799:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1787580198.317610:0:15799:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1787580198.317636:0:15799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae6dfb7e00/0xc86deac20833897e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580198.317643:0:15799:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff8fae6dfb7e00/0xc86deac20833897e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580198.317665:0:15799:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff8fae6dfb7e00/0xc86deac20833897e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580198.317691:0:15799:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d5bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:15799:1874413262833152:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787580198.317721:0:15799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787580198.317746:0:15799:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae50edacc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787580198.317765:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262833152 00000100:00100000:0.0:1787580198.317771:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262833152 00000100:00100000:0.0:1787580198.317853:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787580198.317862:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7f767050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5949e638-96f6-489a-aea1-b9b80ed3224f+16:15799:x1874413262833152:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787580198.317872:0:14390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787580198.317888:0:14390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fae50feb200/0xc86deac208338985 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc86deac20833897e expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580198.317912:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fae50feb200/0xc86deac208338985 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc86deac20833897e expref: 17 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580198.317924:0:14390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fae50feb200/0xc86deac208338985 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac20833897e expref: 17 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580198.317933:0:14390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae50feb200, rc 0) 00000100:00100000:0.0:1787580198.317972:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7f767050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5949e638-96f6-489a-aea1-b9b80ed3224f+17:15799:x1874413262833152:12345-0@lo:101:mount.lustre.0 Request processed in 111us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580198.317978:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787580198.318093:0:15799:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d5bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:15799:1874413262833152:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787580198.318103:0:15799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff8fae6dfb7e00/0xc86deac20833897e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208338985 expref: -99 pid: 15799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580198.318111:0:15799:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff8fae6dfb7e00/0xc86deac20833897e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc86deac208338985 expref: -99 pid: 15799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787580198.319494:0:15799:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1787580198.321929:0:15799:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787580198.322426:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1787580198.322475:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1787580198.322508:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1787580198.322561:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1787580198.322593:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1787580198.322624:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1787580198.322686:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1787580198.322695:0:15799:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1787580198.322790:0:15799:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae507bbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:15799:1874413262833280:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787580198.322878:0:15799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580198.322920:0:15799:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae5bbf9240 going to sleep for 11 seconds 00000100:00100000:0.0:1787580198.324003:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262833280 00000100:00100000:0.0:1787580198.324043:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262833280 00000100:00100000:0.0:1787580198.324101:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787580198.324111:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7f767450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5949e638-96f6-489a-aea1-b9b80ed3224f+17:15799:x1874413262833280:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787580198.324820:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7f767450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5949e638-96f6-489a-aea1-b9b80ed3224f+17:15799:x1874413262833280:12345-0@lo:501:mount.lustre.0 Request processed in 708us (1939us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580198.324841:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787580198.325050:0:15799:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae507bbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:15799:1874413262833280:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787580198.325107:0:15799:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae507bbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:15799:1874413262833408:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787580198.325270:0:15799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580198.325301:0:15799:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae5bbf9240 going to sleep for 11 seconds 00000100:00100000:0.0:1787580198.325421:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262833408 00000100:00100000:0.0:1787580198.325427:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262833408 00000100:00100000:0.0:1787580198.325465:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787580198.325474:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7f766850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5949e638-96f6-489a-aea1-b9b80ed3224f+17:15799:x1874413262833408:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787580198.325790:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7f766850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5949e638-96f6-489a-aea1-b9b80ed3224f+17:15799:x1874413262833408:12345-0@lo:503:mount.lustre.0 Request processed in 316us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580198.325797:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787580198.325848:0:15799:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae507bbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:15799:1874413262833408:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787580198.327264:0:15799:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787580198.327870:0:15799:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7e97c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:15799:1874413262833536:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787580198.327964:0:15799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787580198.328605:0:15799:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae5061b180 going to sleep for 11 seconds 00000100:00100000:0.0:1787580198.328655:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262833536 00000100:00100000:0.0:1787580198.328666:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262833536 00000100:00100000:0.0:1787580198.328802:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787580198.328814:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7f766c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5949e638-96f6-489a-aea1-b9b80ed3224f+17:15799:x1874413262833536:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787580198.329131:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7f766c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5949e638-96f6-489a-aea1-b9b80ed3224f+17:15799:x1874413262833536:12345-0@lo:502:mount.lustre.0 Request processed in 320us (1167us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580198.329141:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787580198.329246:0:15799:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7e97c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:15799:1874413262833536:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787580198.329556:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1787580198.329622:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1787580198.329660:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1787580198.329712:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1787580198.329749:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1787580198.329785:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1787580198.329847:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1787580198.329888:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1787580198.329945:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1787580198.329981:0:15799:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae50728a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:15799:1874413262833664:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787580198.330035:0:15799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580198.330682:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262833664 00000100:00100000:3.0:1787580198.330691:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262833664 00000100:00100000:1.0:1787580198.330741:0:15799:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae4c523600 going to sleep for 11 seconds 00000100:00100000:0.0:1787580198.330760:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787580198.330772:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7f767c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5949e638-96f6-489a-aea1-b9b80ed3224f+17:15799:x1874413262833664:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787580198.331360:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7f767c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5949e638-96f6-489a-aea1-b9b80ed3224f+17:15799:x1874413262833664:12345-0@lo:502:mount.lustre.0 Request processed in 589us (1323us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580198.331369:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787580198.331430:0:15799:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae50728a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:15799:1874413262833664:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787580198.331526:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1787580198.331541:0:15799:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:1.0:1787580198.332474:0:15800:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787580198.332483:0:15800:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1787580198.332490:0:15800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787580198.332492:0:15800:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1787580198.332504:0:15800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787580198.332518:0:15800:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8fae503119b8) 00000020:00000080:1.0:1787580198.332543:0:15800:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787580198.332550:0:15800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787580198.332633:0:15800:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8fae746bf000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1787580198.332642:0:15800:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787580198.332650:0:15800:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc86deac208338993 00010000:00010000:1.0:1787580198.339711:0:15800:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:1.0:1787580198.340697:0:15800:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:1.0:1787580198.342473:0:15800:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1787580198.344222:0:15800:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1787580198.344233:0:15800:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787580198.344240:0:15800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787580198.344242:0:15800:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1787580198.344246:0:15800:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787580198.344251:0:15800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787580198.344252:0:15800:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787580198.344255:0:15800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787580198.344257:0:15800:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787580198.344259:0:15800:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787580198.344261:0:15800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787580198.344263:0:15800:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787580198.344264:0:15800:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787580198.344273:0:15800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787580198.344274:0:15800:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787580198.344278:0:15800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1787580198.344329:0:15800:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787580198.344333:0:15800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787580198.344334:0:15800:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787580198.344337:0:15800:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:2.0:1787580198.344587:0:15799:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1787580198.344624:0:15799:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1787580198.344645:0:15799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae6dfb7e00/0xc86deac20833897e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208338985 expref: -99 pid: 15799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580198.344659:0:15799:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff8fae6dfb7e00/0xc86deac20833897e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208338985 expref: -99 pid: 15799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787580198.344668:0:15799:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8fae746bf000 from 1 10000000:01000000:2.0:1787580198.344671:0:15799:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787580198.344709:0:15799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae6dfb6800/0xc86deac20833899a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580198.344719:0:15799:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff8fae6dfb6800/0xc86deac20833899a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580198.344743:0:15799:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff8fae6dfb6800/0xc86deac20833899a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580198.344770:0:15799:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d5bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:15799:1874413262833792:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787580198.344851:0:15799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787580198.344888:0:15799:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae50eda300 going to sleep for 11 seconds 00000100:00100000:1.0:1787580198.346434:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262833792 00000100:00100000:1.0:1787580198.346444:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262833792 00000100:00100000:1.0:1787580198.346492:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787580198.346502:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7f764050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5949e638-96f6-489a-aea1-b9b80ed3224f+17:15799:x1874413262833792:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787580198.346520:0:14388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787580198.346538:0:14388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fae4ca58a00/0xc86deac2083389a1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc86deac20833899a expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580198.346568:0:14388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fae4ca58a00/0xc86deac2083389a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc86deac20833899a expref: 18 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580198.346579:0:14388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fae4ca58a00/0xc86deac2083389a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac20833899a expref: 18 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580198.346588:0:14388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae4ca58a00, rc 0) 00000100:00100000:1.0:1787580198.346662:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7f764050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5949e638-96f6-489a-aea1-b9b80ed3224f+18:15799:x1874413262833792:12345-0@lo:101:mount.lustre.0 Request processed in 161us (1810us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580198.346669:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787580198.346788:0:15799:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d5bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:15799:1874413262833792:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787580198.346803:0:15799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff8fae6dfb6800/0xc86deac20833899a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac2083389a1 expref: -99 pid: 15799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580198.346810:0:15799:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff8fae6dfb6800/0xc86deac20833899a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc86deac2083389a1 expref: -99 pid: 15799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787580198.347337:0:15799:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1787580198.348063:0:15799:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787580198.348264:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1787580198.348292:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1787580198.348350:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1787580198.348359:0:15799:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1787580198.348628:0:15799:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d5bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:15799:1874413262833920:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787580198.348674:0:15799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787580198.348709:0:15799:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae50eda300 going to sleep for 11 seconds 00000100:00100000:0.0:1787580198.348722:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262833920 00000100:00100000:0.0:1787580198.348729:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262833920 00000100:00100000:0.0:1787580198.348775:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787580198.348783:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7f765850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5949e638-96f6-489a-aea1-b9b80ed3224f+18:15799:x1874413262833920:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787580198.349005:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7f765850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5949e638-96f6-489a-aea1-b9b80ed3224f+18:15799:x1874413262833920:12345-0@lo:501:mount.lustre.0 Request processed in 222us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580198.349014:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787580198.349138:0:15799:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d5bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:15799:1874413262833920:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787580198.349181:0:15799:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae507b8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:15799:1874413262834048:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787580198.349220:0:15799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580198.349245:0:15799:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae48dd2780 going to sleep for 11 seconds 00000100:00100000:1.0:1787580198.349297:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262834048 00000100:00100000:1.0:1787580198.349303:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262834048 00000100:00100000:1.0:1787580198.349348:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787580198.349355:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7f766450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5949e638-96f6-489a-aea1-b9b80ed3224f+18:15799:x1874413262834048:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787580198.349659:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7f766450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5949e638-96f6-489a-aea1-b9b80ed3224f+18:15799:x1874413262834048:12345-0@lo:503:mount.lustre.0 Request processed in 303us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580198.349666:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787580198.349941:0:15799:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae507b8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:15799:1874413262834048:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787580198.351029:0:15799:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787580198.351103:0:15799:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae507b8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:15799:1874413262834176:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787580198.351370:0:15799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580198.351496:0:15799:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae48616540 going to sleep for 11 seconds 00000100:00100000:1.0:1787580198.351532:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262834176 00000100:00100000:1.0:1787580198.351538:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262834176 00000100:00100000:1.0:1787580198.351579:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787580198.351587:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5949e638-96f6-489a-aea1-b9b80ed3224f+18:15799:x1874413262834176:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787580198.351788:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5949e638-96f6-489a-aea1-b9b80ed3224f+18:15799:x1874413262834176:12345-0@lo:502:mount.lustre.0 Request processed in 201us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580198.351795:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787580198.351998:0:15799:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae507b8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:15799:1874413262834176:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787580198.352279:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1787580198.352338:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1787580198.352411:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1787580198.352448:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1787580198.352481:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1787580198.352527:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1787580198.352565:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1787580198.352599:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1787580198.352627:0:15799:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7e97ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:15799:1874413262834304:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787580198.352668:0:15799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580198.352689:0:15799:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae6d204b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787580198.352693:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262834304 00000100:00100000:2.0:1787580198.352698:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262834304 00000100:00100000:2.0:1787580198.352732:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787580198.352740:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5949e638-96f6-489a-aea1-b9b80ed3224f+18:15799:x1874413262834304:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787580198.352895:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5949e638-96f6-489a-aea1-b9b80ed3224f+18:15799:x1874413262834304:12345-0@lo:502:mount.lustre.0 Request processed in 156us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580198.352907:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787580198.353185:0:15799:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7e97ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:15799:1874413262834304:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787580198.353249:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1787580198.353257:0:15799:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1787580198.354409:0:15804:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787580198.354421:0:15804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787580198.354424:0:15804:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787580198.354430:0:15804:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8fae746bf000 00000020:00000080:3.0:1787580198.354432:0:15804:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787580198.354439:0:15804:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787580198.354441:0:15804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787580198.354442:0:15804:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787580198.354444:0:15804:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787580198.354447:0:15804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787580198.354453:0:15804:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787580198.354457:0:15804:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8fae746bf000 00000020:00000080:3.0:1787580198.354459:0:15804:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787580198.354511:0:15804:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787580198.354515:0:15804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787580198.354516:0:15804:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787580198.354519:0:15804:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787580198.354521:0:15804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787580198.354522:0:15804:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787580198.354526:0:15804:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8fae746bf000 00000020:00000080:3.0:1787580198.354528:0:15804:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787580198.354565:0:15804:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787580198.354568:0:15804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787580198.354569:0:15804:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787580198.354572:0:15804:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1787580198.355289:0:15799:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1787580198.355309:0:15799:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787580198.355335:0:15799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae6dfb6800/0xc86deac20833899a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac2083389a1 expref: -99 pid: 15799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580198.355347:0:15799:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff8fae6dfb6800/0xc86deac20833899a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac2083389a1 expref: -99 pid: 15799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787580198.355982:0:15799:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787580198.355986:0:15799:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8fae746bf000 10000000:01000000:0.0:1787580198.355995:0:15799:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8fae746bf000 10000000:01000000:0.0:1787580198.356000:0:15799:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787580198.356006:0:15799:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8fae746bf000 from 1 10000000:01000000:0.0:1787580198.356021:0:15799:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787580198.356063:0:15799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae50fea000/0xc86deac2083389a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580198.356072:0:15799:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff8fae50fea000/0xc86deac2083389a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580198.356084:0:15799:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff8fae50fea000/0xc86deac2083389a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580198.356106:0:15799:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7e97f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:15799:1874413262834432:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787580198.356168:0:15799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580198.356211:0:15799:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae6d204480 going to sleep for 11 seconds 00000100:00100000:3.0:1787580198.356324:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262834432 00000100:00100000:3.0:1787580198.356331:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262834432 00000100:00100000:3.0:1787580198.356379:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787580198.356418:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5949e638-96f6-489a-aea1-b9b80ed3224f+18:15799:x1874413262834432:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787580198.356432:0:14389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787580198.356444:0:14389:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fae5f6d7400/0xc86deac2083389af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xc86deac2083389a8 expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580198.356478:0:14389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fae5f6d7400/0xc86deac2083389af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc86deac2083389a8 expref: 19 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580198.356489:0:14389:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fae5f6d7400/0xc86deac2083389af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac2083389a8 expref: 19 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580198.356498:0:14389:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae5f6d7400, rc 0) 00000100:00100000:3.0:1787580198.356546:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5949e638-96f6-489a-aea1-b9b80ed3224f+19:15799:x1874413262834432:12345-0@lo:101:mount.lustre.0 Request processed in 129us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580198.356556:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787580198.356885:0:15799:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7e97f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:15799:1874413262834432:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787580198.356901:0:15799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff8fae50fea000/0xc86deac2083389a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac2083389af expref: -99 pid: 15799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580198.356911:0:15799:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff8fae50fea000/0xc86deac2083389a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc86deac2083389af expref: -99 pid: 15799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787580198.357581:0:15799:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:0.0:1787580198.357895:0:15799:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787580198.358135:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1787580198.358178:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1787580198.358213:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1787580198.358260:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1787580198.358295:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1787580198.358350:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1787580198.358410:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1787580198.358446:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1787580198.358493:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1787580198.358526:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1787580198.358560:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1787580198.358606:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1787580198.358639:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1787580198.358671:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1787580198.358714:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1787580198.358748:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1787580198.358781:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1787580198.358844:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1787580198.358881:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1787580198.358914:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1787580198.358962:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1787580198.358999:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1787580198.359032:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1787580198.359077:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1787580198.359110:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1787580198.359143:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1787580198.359188:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1787580198.359225:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1787580198.359260:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1787580198.359306:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:0.0:1787580198.359340:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:0.0:1787580198.359374:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:0.0:1787580198.359436:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:0.0:1787580198.359485:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:0.0:1787580198.359521:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:0.0:1787580198.359588:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:0.0:1787580198.359625:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:0.0:1787580198.359711:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:0.0:1787580198.359726:0:15799:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:0.0:1787580198.359802:0:15799:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7e97f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:15799:1874413262834560:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787580198.363071:0:15799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580198.363127:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262834560 00000100:00100000:0.0:1787580198.363138:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262834560 00000100:00100000:0.0:1787580198.363188:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787580198.363199:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5949e638-96f6-489a-aea1-b9b80ed3224f+19:15799:x1874413262834560:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787580198.363443:0:15799:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae6d204480 going to sleep for 11 seconds 00000100:00100000:0.0:1787580198.363498:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5949e638-96f6-489a-aea1-b9b80ed3224f+19:15799:x1874413262834560:12345-0@lo:501:mount.lustre.0 Request processed in 301us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580198.363507:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787580198.363564:0:15799:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7e97f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:15799:1874413262834560:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787580198.363620:0:15799:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae50728a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:15799:1874413262834688:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787580198.363661:0:15799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787580198.363674:0:15799:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae45fc2600 going to sleep for 11 seconds 00000100:00100000:0.0:1787580198.365120:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262834688 00000100:00100000:0.0:1787580198.365133:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262834688 00000100:00100000:0.0:1787580198.365189:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787580198.365199:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5949e638-96f6-489a-aea1-b9b80ed3224f+19:15799:x1874413262834688:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787580198.365593:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5949e638-96f6-489a-aea1-b9b80ed3224f+19:15799:x1874413262834688:12345-0@lo:503:mount.lustre.0 Request processed in 394us (1929us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580198.365602:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787580198.365664:0:15799:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae50728a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:15799:1874413262834688:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787580198.366376:0:15799:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787580198.366704:0:15799:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae50728a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:15799:1874413262834816:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787580198.366761:0:15799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787580198.366800:0:15799:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae45fc2600 going to sleep for 11 seconds 00000100:00100000:1.0:1787580198.367856:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262834816 00000100:00100000:1.0:1787580198.367866:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262834816 00000100:00100000:1.0:1787580198.367927:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787580198.367938:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5949e638-96f6-489a-aea1-b9b80ed3224f+19:15799:x1874413262834816:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787580198.368687:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5949e638-96f6-489a-aea1-b9b80ed3224f+19:15799:x1874413262834816:12345-0@lo:502:mount.lustre.0 Request processed in 749us (1923us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580198.368698:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787580198.368770:0:15799:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae50728a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:15799:1874413262834816:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787580198.370256:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1787580198.370359:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1787580198.370414:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1787580198.370726:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1787580198.370769:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1787580198.370818:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1787580198.370872:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1787580198.370918:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1787580198.370965:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1787580198.371003:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1787580198.371038:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1787580198.371084:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1787580198.371120:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1787580198.371152:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1787580198.371671:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1787580198.371709:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1787580198.371748:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1787580198.371814:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1787580198.372651:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1787580198.372687:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1787580198.372733:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1787580198.372761:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1787580198.372784:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1787580198.372819:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1787580198.372864:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1787580198.373297:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1787580198.373365:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1787580198.374292:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1787580198.374327:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1787580198.374409:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1787580198.374702:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1787580198.374736:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1787580198.374763:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1787580198.374804:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1787580198.374845:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1787580198.374955:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1787580198.374993:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1787580198.375025:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1787580198.375071:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1787580198.375107:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1787580198.375578:0:15799:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae50728a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:15799:1874413262834944:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787580198.375666:0:15799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787580198.375719:0:15799:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae45fc2600 going to sleep for 11 seconds 00000100:00100000:0.0:1787580198.375865:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262834944 00000100:00100000:0.0:1787580198.375874:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262834944 00000100:00100000:0.0:1787580198.375924:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787580198.375934:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5949e638-96f6-489a-aea1-b9b80ed3224f+19:15799:x1874413262834944:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787580198.376233:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5949e638-96f6-489a-aea1-b9b80ed3224f+19:15799:x1874413262834944:12345-0@lo:502:mount.lustre.0 Request processed in 300us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580198.376241:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787580198.376271:0:15799:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae50728a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:15799:1874413262834944:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787580198.376348:0:15799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1787580198.376359:0:15799:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1787580198.381368:0:15809:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1787580198.381402:0:15809:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8fae521799b8) 00000020:00000080:0.0:1787580198.381426:0:15809:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:0.0:1787580198.381517:0:15809:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8fae746bf000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787580198.381522:0:15809:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8fae746bf000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787580198.381525:0:15809:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8fae746bf000 3 00010000:00080000:0.0:1787580198.381558:0:15809:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8fae4ce2f000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.136@tcp at head 00010000:00010000:0.0:1787580198.383151:0:15809:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:0.0:1787580198.383355:0:15809:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1787580198.383413:0:15809:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787580198.383425:0:15809:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xc86deac2083389bd 00000100:00080000:0.0:1787580198.383435:0:15809:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787580198.383442:0:15809:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8fae4ce2f000 using connection 192.168.202.136@tcp/0@lo 00000100:00100000:0.0:1787580198.383481:0:15809:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fae7e97fb80 x1874413262835072/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787580198.383516:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7e97fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3313:1874413262835072:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787580198.383598:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787580198.383661:0:15809:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787580198.384838:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787580198.384845:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787580198.384849:0:36:0:(import.c:65:import_set_state_nolock()) ffff8fae7f61c000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787580198.384855:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 545 00000100:00080000:2.0:1787580198.384860:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1787580198.384865:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8fae7f61c000 using connection 192.168.202.136@tcp/0@lo 00000100:00100000:2.0:1787580198.384886:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fae6d5ba680 x1874413262835328/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787580198.385114:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d5bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874413262835200:0@lo:400:kworker.0 00000100:00100000:0.0:1787580198.385163:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580198.385213:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d5b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1874413262835584:0@lo:400:kworker.0 00000100:00100000:0.0:1787580198.385262:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580198.385284:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787580198.385290:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d5b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874413262835456:0@lo:400:kworker.0 00000100:00100000:0.0:1787580198.385311:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580198.386568:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d5ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1874413262835328:0@lo:8:kworker.0 00000100:00100000:0.0:1787580198.386605:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:0.0:1787580198.386780:0:15809:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:0.0:1787580198.387441:0:15799:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 00000100:00100000:2.0:1787580198.387649:0:15079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262835200 00000100:00100000:2.0:1787580198.387659:0:15079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262835200 10000000:01000000:0.0:1787580198.387840:0:15799:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'lustre-client' succeeded (0). 00000100:00100000:2.0:1787580198.387849:0:15079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262835328 00000100:00100000:2.0:1787580198.387853:0:15079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262835328 00010000:00010000:0.0:1787580198.387854:0:15799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae50fea000/0xc86deac2083389a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac2083389af expref: -99 pid: 15799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580198.387865:0:15799:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff8fae50fea000/0xc86deac2083389a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac2083389af expref: -99 pid: 15799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580198.387868:0:15079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787580198.387877:0:15079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7e97e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1874413262835200:12345-0@lo:400:kworker.0 00000020:01000004:0.0:1787580198.387911:0:15799:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787580198.387913:0:15799:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787580198.387914:0:15799:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787580198.387915:0:15799:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787580198.387916:0:15799:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787580198.387917:0:15799:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787580198.387919:0:15799:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787580198.387920:0:15799:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787580198.387922:0:15799:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787580198.387925:0:15799:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1787580198.387928:0:15799:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787580198.387929:0:15799:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787580198.387930:0:15799:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787580198.387931:0:15799:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787580198.387932:0:15799:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787580198.387933:0:15799:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787580198.387934:0:15799:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787580198.387936:0:15799:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787580198.387937:0:15799:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787580198.387960:0:15799:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787580198.387976:0:15799:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7ec35c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:15799:1874413262835712:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787580198.388036:0:15799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787580198.388064:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262835712 00000100:00100000:1.0:1787580198.388068:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262835712 00000100:00100000:0.0:1787580198.388073:0:15799:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae54f5c000 going to sleep for 11 seconds 00000100:00100000:1.0:1787580198.388095:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787580198.388101:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5949e638-96f6-489a-aea1-b9b80ed3224f+19:15799:x1874413262835712:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787580198.388126:0:14388:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1787580198.388141:0:14388:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1787580198.389324:0:15079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7e97e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1874413262835200:12345-0@lo:400:kworker.0 Request processed in 1443us (4154us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580198.389336:0:15079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787580198.389361:0:15079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787580198.389367:0:15079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7e97c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3313:x1874413262835328:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1787580198.389573:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d5bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874413262835200:0@lo:400:kworker.0 00000100:00100000:2.0:1787580198.390605:0:15079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7e97c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3313:x1874413262835328:12345-0@lo:8:kworker.0 Request processed in 1231us (3994us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787580198.390616:0:15079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787580198.390650:0:15103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262835072 00000100:00100000:2.0:1787580198.390657:0:15103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262835072 00000100:00100000:2.0:1787580198.390690:0:15103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262835584 00000100:00100000:0.0:1787580198.390855:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262835456 00000100:00100000:0.0:1787580198.390861:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262835456 00000100:00100000:0.0:1787580198.390889:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787580198.390906:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7e97ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874413262835456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787580198.390966:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7e97ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1874413262835456:12345-0@lo:400:kworker.0 Request processed in 61us (5652us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580198.390973:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787580198.390987:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787580198.390991:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7e97ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3313:x1874413262835072:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787580198.391075:0:14397:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 546 last 0 00000020:00000080:0.0:1787580198.391109:0:14397:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xc86deac2083389c4 00000004:00100000:0.0:1787580198.391123:0:14397:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787580198.391152:0:14397:0:(import.c:65:import_set_state_nolock()) ffff8fae50610800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787580198.391188:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7e97ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874413262835072:12345-0@lo:38:llog_process_th.0 Request processed in 194us (7590us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580198.391194:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787580198.391232:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fae6d5b9c00 x1874413262835456/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787580214 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787580198.391244:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d5b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3315:1874413262835456:0@lo:400:kworker.0 00000100:00100000:2.0:1787580198.391588:0:15103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262835584 00000100:00100000:2.0:1787580198.391617:0:15103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787580198.391624:0:15103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7e97f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874413262835584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787580198.391661:0:15103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7e97f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1874413262835584:12345-0@lo:400:kworker.0 Request processed in 38us (6400us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580198.391668:0:15103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787580198.393056:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787580198.393067:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8fae7f61c000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787580198.393072:0:3313:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1787580198.393077:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d5ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1874413262835328:0@lo:8:kworker.0 00010000:00080000:2.0:1787580198.393099:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fae7e97fb80 x1874413262835072/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787580208 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787580198.393110:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787580198.393116:0:3313:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1787580198.393125:0:3313:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787580198.393130:0:3313:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787580198.393133:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8fae4ce2f000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787580198.393138:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7e97fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3313:1874413262835072:0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787580198.402320:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8fae6d5b9f80 x1874413262835584/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787580214 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787580198.402342:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d5b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3315:1874413262835584:0@lo:400:kworker.0 20000000:01000000:3.0:1787580198.438277:0:14388:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787580198.438307:0:14388:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1787580198.438797:0:14411:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787580198.438803:0:14411:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787580198.438844:0:14411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8fae6dfb6c00/0xc86deac2083389cb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580198.438898:0:14411:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fae50feaa00/0xc86deac20833889e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac208338897 expref: 19 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580198.438909:0:14411:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8fae6dfb6c00/0xc86deac2083389cb lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580198.438959:0:14411:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fae50feaa00/0xc86deac20833889e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc86deac208338897 expref: 19 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580198.438974:0:14411:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8fae50feaa00/0xc86deac20833889e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc86deac208338897 expref: 19 pid: 14388 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580198.438989:0:14411:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d5b9f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14411:1874413262835840:0@lo:104: 00000100:00100000:2.0:1787580198.439055:0:14411:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787580198.439114:0:14411:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae436f8b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787580198.439274:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262835840 00000100:00100000:1.0:1787580198.439283:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262835840 00000100:00100000:1.0:1787580198.439337:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787580198.439346:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d5ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5949e638-96f6-489a-aea1-b9b80ed3224f+3:14411:x1874413262835840:12345-0@lo:104: 00010000:00010000:1.0:1787580198.439365:0:14379:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.136@tcp lock: ffff8fae4ca58000/0xc86deac208338897 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc86deac20833889e expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580198.439474:0:14379:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787580198.439481:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d5ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5949e638-96f6-489a-aea1-b9b80ed3224f+3:14411:x1874413262835840:12345-0@lo:104: Request processed in 135us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580198.439488:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1787580198.439510:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787580198.439516:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.136@tcp lock: ffff8fae4ca58000/0xc86deac208338897 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc86deac20833889e expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580198.439525:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae4ca58000 already unused, calling callback (ffffffffc1b77c20) 10000000:00010000:1.0:1787580198.439529:0:14384:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.136@tcp lock: ffff8fae4ca58000/0xc86deac208338897 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc86deac20833889e expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580198.439537:0:14384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: ffff8fae4ca58000/0xc86deac208338897 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc86deac20833889e expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787580198.439545:0:14384:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: ffff8fae4ca58000/0xc86deac208338897 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc86deac20833889e expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787580198.439551:0:14384:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787580198.439583:0:14384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.136@tcp lock: ffff8fae4ca58000/0xc86deac208338897 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac20833889e expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580198.439589:0:14384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787580198.439608:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.136@tcp lock: ffff8fae4ca58000/0xc86deac208338897 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac20833889e expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580198.439614:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: ffff8fae4ca58000/0xc86deac208338897 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac20833889e expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580198.439638:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787580198.439640:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787580198.439641:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787580198.439664:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae50728a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5949e638-96f6-489a-aea1-b9b80ed3224f:3316:1874413262835968:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787580198.439695:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787580198.439738:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262835968 00000100:00100000:1.0:1787580198.439743:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262835968 00010000:00010000:1.0:1787580198.439760:0:14382:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fae50feaa00/0xc86deac20833889e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc86deac208338897 expref: 20 pid: 14388 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580198.439791:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787580198.439799:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae50728e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5949e638-96f6-489a-aea1-b9b80ed3224f+20:3316:x1874413262835968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787580198.439811:0:14382:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787580198.439818:0:14382:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fae50feaa00/0xc86deac20833889e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc86deac208338897 expref: 20 pid: 14388 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580198.439837:0:14382:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fae50feaa00/0xc86deac20833889e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc86deac208338897 expref: 20 pid: 14388 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580198.439854:0:14382:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8fae6dfb6c00/0xc86deac2083389cb lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580198.439861:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fae6dfb6c00/0xc86deac2083389cb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787580198.439875:0:14382:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006060868s 00010000:00010000:1.0:1787580198.439879:0:14382:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fae6dfb6c00/0xc86deac2083389cb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580198.439896:0:14382:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fae6dfb6c00/0xc86deac2083389cb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580198.439903:0:14382:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8fae6dfb6c00/0xc86deac2083389cb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580198.439909:0:14382:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8fae6dfb6c00/0xc86deac2083389cb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580198.439914:0:14382:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae6dfb6c00 already unused, calling callback (ffffffffc155a230) 00010000:00010000:1.0:1787580198.439919:0:14382:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8fae6dfb6c00/0xc86deac2083389cb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580198.439926:0:14382:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8fae6dfb6c00/0xc86deac2083389cb lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580198.439935:0:14382:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8fae6dfb6c00/0xc86deac2083389cb lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580198.439945:0:14382:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787580198.439981:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae50728e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5949e638-96f6-489a-aea1-b9b80ed3224f+20:3316:x1874413262835968:12345-0@lo:103:ldlm_bl.0 Request processed in 183us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580198.439988:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787580198.440018:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae50728a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5949e638-96f6-489a-aea1-b9b80ed3224f:3316:1874413262835968:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787580198.440275:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fae50feaa00/0xc86deac20833889e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc86deac208338897 expref: 19 pid: 14388 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580198.440286:0:14411:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d5b9f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14411:1874413262835840:0@lo:104: 00010000:00010000:1.0:1787580198.440299:0:14411:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8fae6dfb6c00/0xc86deac2083389cb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580198.440318:0:14411:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8fae6dfb6c00/0xc86deac2083389cb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580198.440325:0:14411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8fae6dfb6c00/0xc86deac2083389cb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580198.440331:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fae6dfb6c00/0xc86deac2083389cb lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580198.451362:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5949e638-96f6-489a-aea1-b9b80ed3224f+18:15799:x1874413262835712:12345-0@lo:253:mount.lustre.0 Request processed in 63248us (63312us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580198.451426:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787580198.451582:0:15799:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7ec35c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5949e638-96f6-489a-aea1-b9b80ed3224f:15799:1874413262835712:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787580198.451605:0:15799:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787580198.451608:0:15799:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787580198.451610:0:15799:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787580198.451611:0:15799:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787580198.451613:0:15799:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787580198.451614:0:15799:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787580198.451615:0:15799:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787580198.451617:0:15799:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787580198.451620:0:15799:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787580198.451622:0:15799:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787580198.451640:0:15799:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787580198.457982:0:15799:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1787580198.458221:0:15799:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787580198.458365:0:15799:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1787580198.458596:0:15799:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787580198.458808:0:15799:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1787580198.459111:0:15799:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1787580198.461947:0:15799:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1787580198.491718:0:15799:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1787580198.491729:0:15799:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1787580198.491757:0:15799:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787580198.491812:0:15799:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.136@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787580198.491837:0:15799:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1787580198.491865:0:15799:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00000040:00080000:3.0:1787580198.581039:0:14427:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787580199.155907:0:15522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787580200.053127:0:14393:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787580200.053145:0:14393:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8fae50b5d800 from 8 10000000:01000000:3.0:1787580200.053151:0:14393:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787580200.053199:0:14393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae5f6d7c00/0xc86deac2083389d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580200.053211:0:14393:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff8fae5f6d7c00/0xc86deac2083389d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580200.053223:0:14393:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff8fae5f6d7c00/0xc86deac2083389d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580200.053251:0:14393:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae507b9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5949e638-96f6-489a-aea1-b9b80ed3224f:14393:1874413262836096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787580200.053352:0:14393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580200.053438:0:14393:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae45236900 going to sleep for 11 seconds 00000100:00100000:0.0:1787580200.055156:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262836096 00000100:00100000:0.0:1787580200.055176:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262836096 00000100:00100000:0.0:1787580200.055246:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787580200.055260:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51d1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5949e638-96f6-489a-aea1-b9b80ed3224f+18:14393:x1874413262836096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787580200.055280:0:14390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787580200.055307:0:14390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fae50feb000/0xc86deac2083389d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc86deac2083389d2 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580200.055348:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fae50feb000/0xc86deac2083389d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc86deac2083389d2 expref: 19 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580200.055361:0:14390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fae50feb000/0xc86deac2083389d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac2083389d2 expref: 19 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580200.055370:0:14390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae50feb000, rc 0) 00000100:00100000:0.0:1787580200.055457:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51d1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5949e638-96f6-489a-aea1-b9b80ed3224f+19:14393:x1874413262836096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 200us (2105us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580200.055464:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787580200.056358:0:14393:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae507b9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5949e638-96f6-489a-aea1-b9b80ed3224f:14393:1874413262836096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787580200.056406:0:14393:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff8fae5f6d7c00/0xc86deac2083389d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac2083389d9 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580200.056427:0:14393:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff8fae5f6d7c00/0xc86deac2083389d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc86deac2083389d9 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580200.056497:0:14393:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae507b9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5949e638-96f6-489a-aea1-b9b80ed3224f:14393:1874413262836224:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787580200.056545:0:14393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580200.056591:0:14393:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae45236900 going to sleep for 11 seconds 00000100:00100000:0.0:1787580200.057243:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262836224 00000100:00100000:0.0:1787580200.057251:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262836224 00000100:00100000:0.0:1787580200.057301:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787580200.057310:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d514850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5949e638-96f6-489a-aea1-b9b80ed3224f+19:14393:x1874413262836224:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787580200.057337:0:14388:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787580200.057356:0:14388:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787580200.057358:0:14388:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1787580200.057467:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d514850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5949e638-96f6-489a-aea1-b9b80ed3224f+19:14393:x1874413262836224:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 158us (921us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580200.057475:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787580200.058038:0:14393:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae507b9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5949e638-96f6-489a-aea1-b9b80ed3224f:14393:1874413262836224:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787580200.058107:0:14393:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787580200.058116:0:14393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae5f6d7c00/0xc86deac2083389d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac2083389d9 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580200.058126:0:14393:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff8fae5f6d7c00/0xc86deac2083389d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac2083389d9 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580200.180601:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787580201.215486:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787580202.227654:0:15522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787580203.124273:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787580203.124294:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae507b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262836352:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787580203.124362:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580203.124461:0:15083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262836352 00000100:00100000:3.0:1787580203.124470:0:15083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262836352 00000100:00100000:3.0:1787580203.124523:0:15083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787580203.124544:0:15083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae507b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262836352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787580203.124580:0:15083:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787580203.124628:0:15083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae507b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262836352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580203.124635:0:15083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1787580203.124675:0:14391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787580203.124717:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae507b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262836352:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787580203.251521:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787580203.636567:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787580203.636574:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787580203.636577:0:37:0:(import.c:65:import_set_state_nolock()) ffff8fae7f61c000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787580203.636589:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8fae7f61c000 using connection 192.168.202.136@tcp/0@lo 00000100:00100000:1.0:1787580203.636611:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8fae5072b100 x1874413262836736/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787580203.636671:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae50728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874413262836608:0@lo:400:kworker.0 00000100:00100000:1.0:1787580203.636745:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787580203.636812:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787580203.636819:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae50729500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5949e638-96f6-489a-aea1-b9b80ed3224f:3315:1874413262836480:0@lo:400:kworker.0 00000100:00100000:1.0:1787580203.636856:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787580203.636879:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5072ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1874413262837120:0@lo:400:kworker.0 00000100:00100000:1.0:1787580203.636937:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787580203.636963:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5072b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1874413262836736:0@lo:8:kworker.0 00000100:00100000:1.0:1787580203.636997:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787580203.637023:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5072a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874413262836864:0@lo:400:kworker.0 00000100:00100000:1.0:1787580203.637045:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787580203.637059:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787580203.637064:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae50729f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874413262836992:0@lo:400:kworker.0 00000100:00100000:1.0:1787580203.637084:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787580203.637121:0:15079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262836608 00000100:00100000:1.0:1787580203.637128:0:15079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262836608 00000100:00100000:1.0:1787580203.637177:0:15079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262836736 00000100:00100000:1.0:1787580203.637180:0:15079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262836736 00000100:00100000:1.0:1787580203.637194:0:15079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787580203.637203:0:15079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae50728a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1874413262836608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787580203.637256:0:15079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae50728a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1874413262836608:12345-0@lo:400:kworker.0 Request processed in 53us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580203.637263:0:15079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787580203.637281:0:15079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787580203.637285:0:15079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5072bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3313:x1874413262836736:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1787580203.637310:0:15079:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 551 last 0 00000020:00000080:1.0:1787580203.637341:0:15079:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc86deac2083389e0 00002000:00100000:1.0:1787580203.637356:0:15079:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8fad42d12800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113950 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1787580203.637360:0:15079:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1787580203.637363:0:15079:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787580203.637738:0:15079:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787580203.637763:0:15079:0:(import.c:65:import_set_state_nolock()) ffff8fad42d11800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787580203.637820:0:15079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5072bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3313:x1874413262836736:12345-0@lo:8:kworker.0 Request processed in 532us (822us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580203.637840:0:15079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787580203.637866:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262836480 00000100:00100000:1.0:1787580203.637870:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262836480 00000100:00100000:1.0:1787580203.637897:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787580203.637904:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d515850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5949e638-96f6-489a-aea1-b9b80ed3224f+19:3315:x1874413262836480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787580203.637933:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d515850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5949e638-96f6-489a-aea1-b9b80ed3224f+19:3315:x1874413262836480:12345-0@lo:400:kworker.0 Request processed in 30us (1077us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580203.637939:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787580203.637966:0:15103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262837120 00000100:00100000:1.0:1787580203.637969:0:15103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262837120 00000100:00100000:1.0:1787580203.637996:0:15103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262836864 00000100:00100000:1.0:1787580203.637999:0:15103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262836864 00000100:00100000:1.0:1787580203.638009:0:15103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262836992 00000100:00100000:1.0:1787580203.638011:0:15103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262836992 00000100:00100000:1.0:1787580203.638026:0:15103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787580203.638031:0:15103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5072a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874413262837120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787580203.638059:0:15103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5072a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1874413262837120:12345-0@lo:400:kworker.0 Request processed in 29us (1123us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580203.638065:0:15103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787580203.638077:0:15103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787580203.638082:0:15103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae50729180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874413262836864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787580203.638112:0:15103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae50729180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874413262836864:12345-0@lo:400:kworker.0 Request processed in 29us (1066us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580203.638117:0:15103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787580203.638126:0:15103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787580203.638132:0:15103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5072b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874413262836992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787580203.638167:0:15103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5072b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874413262836992:12345-0@lo:400:kworker.0 Request processed in 35us (1082us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580203.638173:0:15103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1787580203.638214:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae5072b100 x1874413262836736/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787580228 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787580203.638228:0:3313:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1787580203.638235:0:3313:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787580203.638239:0:3313:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1787580203.638242:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8fae7f61c000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787580203.638254:0:3313:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787580203.638259:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5072b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3313:1874413262836736:0@lo:8:kworker.0 00000004:00080000:1.0:1787580203.638283:0:14419:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787580203.638625:0:14419:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 551394239495ns, next at 0ns, rc = 0 00010000:00080000:1.0:1787580203.638931:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae50729f80 x1874413262836992/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787580219 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787580203.638942:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae50729f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874413262836992:0@lo:400:kworker.0 00010000:00080000:1.0:1787580203.638953:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae5072a680 x1874413262836864/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787580219 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787580203.638961:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5072a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874413262836864:0@lo:400:kworker.0 00000100:00100000:1.0:1787580203.638987:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae50729500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5949e638-96f6-489a-aea1-b9b80ed3224f:3315:1874413262836480:0@lo:400:kworker.0 00010000:00080000:1.0:1787580203.638998:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae5072ad80 x1874413262837120/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787580219 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787580203.639006:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5072ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3315:1874413262837120:0@lo:400:kworker.0 00000100:00100000:1.0:1787580203.639029:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae50728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874413262836608:0@lo:400:kworker.0 00000100:00080000:3.0:1787580203.639250:0:14391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:3.0:1787580203.639305:0:14420:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:3.0:1787580203.639326:0:14420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae507bb480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14420:1874413262837376:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1787580203.639371:0:14420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580203.639420:0:14420:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fad43647480 going to sleep for 11 seconds 00000100:00100000:3.0:1787580203.640270:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787580203.640286:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae507b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874413262837248:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787580203.640325:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580203.640363:0:15083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262837248 00000100:00100000:3.0:1787580203.640370:0:15083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262837248 00000100:00100000:3.0:1787580203.640442:0:15083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787580203.640450:0:15083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae507bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1874413262837248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787580203.640478:0:15083:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787580203.640521:0:15083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae507bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1874413262837248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580203.640527:0:15083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1787580203.640547:0:14391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787580203.640569:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8fae507b9880 x1874413262837248/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787580219 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787580203.640586:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae507b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874413262837248:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787580203.640608:0:15079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262837376 00000100:00100000:3.0:1787580203.640611:0:15079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262837376 00000100:00100000:3.0:1787580203.640636:0:15079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787580203.640643:0:15079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae507b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14420:x1874413262837376:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1787580203.652319:0:15079:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1787580203.652331:0:15079:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1787580203.652337:0:15079:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00002000:00010000:3.0:1787580203.679818:0:15079:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787580203.679834:0:15079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000947b83b6/0xc86deac2083389e7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.679853:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=551s v=(0 0) 00010000:00010000:3.0:1787580203.679857:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787580203.679865:0:15079:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000947b83b6/0xc86deac2083389e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.679885:0:15079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000947b83b6/0xc86deac2083389e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.679896:0:15079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000947b83b6/0xc86deac2083389e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.679906:0:15079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000947b83b6/0xc86deac2083389e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.679930:0:15079:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787580203.680454:0:15079:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787580203.680461:0:15079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f4114af/0xc86deac2083389ee lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.680470:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=551s v=(0 0) 00010000:00010000:3.0:1787580203.680480:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787580203.680484:0:15079:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f4114af/0xc86deac2083389ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.680495:0:15079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001f4114af/0xc86deac2083389ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.680505:0:15079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f4114af/0xc86deac2083389ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.680513:0:15079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001f4114af/0xc86deac2083389ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.680542:0:15079:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787580203.680556:0:15522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787580203.680562:0:15522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000947b83b6/0xc86deac2083389e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.680571:0:15522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae5f6d7000 already unused, calling callback (ffffffffc155a230) 00010000:00010000:3.0:1787580203.680576:0:15522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000947b83b6/0xc86deac2083389e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.680586:0:15522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000947b83b6/0xc86deac2083389e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.680603:0:15522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000947b83b6/0xc86deac2083389e7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.680622:0:15522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000947b83b6/0xc86deac2083389e7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.680640:0:15522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787580203.680644:0:15522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001f4114af/0xc86deac2083389ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.680650:0:15522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae5f6d6c00 already unused, calling callback (ffffffffc155a230) 00010000:00010000:3.0:1787580203.680654:0:15522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001f4114af/0xc86deac2083389ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.680662:0:15522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001f4114af/0xc86deac2083389ee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.680672:0:15522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001f4114af/0xc86deac2083389ee lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.680681:0:15522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001f4114af/0xc86deac2083389ee lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.680693:0:15522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787580203.680694:0:15522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787580203.680696:0:15522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787580203.681093:0:15079:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787580203.681099:0:15079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3e03c02/0xc86deac2083389f5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.681114:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=551s v=(0 0) 00010000:00010000:3.0:1787580203.681117:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787580203.681121:0:15079:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a3e03c02/0xc86deac2083389f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.681131:0:15079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a3e03c02/0xc86deac2083389f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.681138:0:15079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3e03c02/0xc86deac2083389f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.681144:0:15079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a3e03c02/0xc86deac2083389f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.681159:0:15079:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787580203.681168:0:14383:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787580203.681172:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a3e03c02/0xc86deac2083389f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.681178:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae5f6d6400 already unused, calling callback (ffffffffc155a230) 00010000:00010000:3.0:1787580203.681181:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3e03c02/0xc86deac2083389f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.681187:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3e03c02/0xc86deac2083389f5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.681207:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a3e03c02/0xc86deac2083389f5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.681215:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a3e03c02/0xc86deac2083389f5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.681226:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787580203.681228:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787580203.681230:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787580203.681616:0:15079:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787580203.681623:0:15079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a4c0f800/0xc86deac2083389fc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.681633:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=551s v=(0 0) 00010000:00010000:3.0:1787580203.681636:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787580203.681640:0:15079:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a4c0f800/0xc86deac2083389fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.681650:0:15079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a4c0f800/0xc86deac2083389fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.681657:0:15079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a4c0f800/0xc86deac2083389fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.681663:0:15079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a4c0f800/0xc86deac2083389fc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.681685:0:15079:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787580203.681694:0:15522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787580203.681697:0:15522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a4c0f800/0xc86deac2083389fc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.681703:0:15522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae5f6d6600 already unused, calling callback (ffffffffc155a230) 00010000:00010000:3.0:1787580203.681706:0:15522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4c0f800/0xc86deac2083389fc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.681714:0:15522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4c0f800/0xc86deac2083389fc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.681724:0:15522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a4c0f800/0xc86deac2083389fc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.681731:0:15522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a4c0f800/0xc86deac2083389fc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.681743:0:15522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787580203.681744:0:15522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787580203.681746:0:15522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787580203.682140:0:15079:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787580203.682145:0:15079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a6998ca/0xc86deac208338a03 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.682153:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=551s v=(0 0) 00010000:00010000:3.0:1787580203.682161:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787580203.682166:0:15079:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a6998ca/0xc86deac208338a03 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.682175:0:15079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008a6998ca/0xc86deac208338a03 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.682183:0:15079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a6998ca/0xc86deac208338a03 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.682190:0:15079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008a6998ca/0xc86deac208338a03 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.682204:0:15079:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787580203.682212:0:14383:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787580203.682216:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008a6998ca/0xc86deac208338a03 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.682223:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae5f6d6a00 already unused, calling callback (ffffffffc155a230) 00010000:00010000:3.0:1787580203.682226:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008a6998ca/0xc86deac208338a03 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.682234:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008a6998ca/0xc86deac208338a03 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.682244:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008a6998ca/0xc86deac208338a03 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.682262:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008a6998ca/0xc86deac208338a03 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.682275:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787580203.682277:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787580203.682278:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787580203.682748:0:15079:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787580203.682754:0:15079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000607b5f73/0xc86deac208338a0a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.682762:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=551s v=(0 0) 00010000:00010000:3.0:1787580203.682765:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787580203.682769:0:15079:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000607b5f73/0xc86deac208338a0a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580203.684903:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787580203.691471:0:15079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000607b5f73/0xc86deac208338a0a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.691489:0:15079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000607b5f73/0xc86deac208338a0a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.691496:0:15079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000607b5f73/0xc86deac208338a0a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.692237:0:15079:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787580203.692252:0:15522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787580203.692269:0:15522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000607b5f73/0xc86deac208338a0a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.692279:0:15522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae5f6d6800 already unused, calling callback (ffffffffc155a230) 00010000:00010000:3.0:1787580203.692284:0:15522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000607b5f73/0xc86deac208338a0a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.692292:0:15522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000607b5f73/0xc86deac208338a0a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.692312:0:15522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000607b5f73/0xc86deac208338a0a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.692320:0:15522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000607b5f73/0xc86deac208338a0a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.692340:0:15522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787580203.692343:0:15522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787580203.692345:0:15522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787580203.694079:0:15079:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787580203.694093:0:15079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024ec28a2/0xc86deac208338a11 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.694110:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=551s v=(0 0) 00010000:00010000:3.0:1787580203.694114:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787580203.694120:0:15079:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024ec28a2/0xc86deac208338a11 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.694147:0:15079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000024ec28a2/0xc86deac208338a11 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.694155:0:15079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024ec28a2/0xc86deac208338a11 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.694163:0:15079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000024ec28a2/0xc86deac208338a11 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.694182:0:15079:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787580203.694194:0:14383:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787580203.694200:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000024ec28a2/0xc86deac208338a11 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.694206:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae5f6d7200 already unused, calling callback (ffffffffc155a230) 00010000:00010000:3.0:1787580203.694211:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000024ec28a2/0xc86deac208338a11 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.694218:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000024ec28a2/0xc86deac208338a11 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.694233:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000024ec28a2/0xc86deac208338a11 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.694241:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000024ec28a2/0xc86deac208338a11 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.694268:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787580203.694271:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787580203.694272:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787580203.696884:0:15079:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787580203.696896:0:15079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000491189dc/0xc86deac208338a18 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.696912:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=551s v=(0 0) 00010000:00010000:3.0:1787580203.696917:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787580203.696923:0:15079:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000491189dc/0xc86deac208338a18 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.696937:0:15079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000491189dc/0xc86deac208338a18 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.696947:0:15079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000491189dc/0xc86deac208338a18 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.696956:0:15079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000491189dc/0xc86deac208338a18 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.696976:0:15079:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787580203.698427:0:15079:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787580203.698438:0:15079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009124aa27/0xc86deac208338a1f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.698463:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=551s v=(0 0) 00010000:00010000:3.0:1787580203.698466:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787580203.698471:0:15079:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009124aa27/0xc86deac208338a1f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.698483:0:15079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009124aa27/0xc86deac208338a1f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.698493:0:15079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009124aa27/0xc86deac208338a1f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.698502:0:15079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009124aa27/0xc86deac208338a1f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.698522:0:15079:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787580203.698621:0:15522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787580203.698629:0:15522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000491189dc/0xc86deac208338a18 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580203.698657:0:15522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae5f6d7a00 already unused, calling callback (ffffffffc155a230) 00010000:00010000:2.0:1787580203.698662:0:15522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000491189dc/0xc86deac208338a18 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580203.698681:0:15522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000491189dc/0xc86deac208338a18 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580203.698702:0:15522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000491189dc/0xc86deac208338a18 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580203.698710:0:15522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000491189dc/0xc86deac208338a18 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580203.698728:0:15522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787580203.698732:0:15522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009124aa27/0xc86deac208338a1f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580203.698739:0:15522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae40031400 already unused, calling callback (ffffffffc155a230) 00010000:00010000:2.0:1787580203.698743:0:15522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009124aa27/0xc86deac208338a1f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580203.698751:0:15522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009124aa27/0xc86deac208338a1f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580203.698761:0:15522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009124aa27/0xc86deac208338a1f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580203.698784:0:15522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009124aa27/0xc86deac208338a1f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580203.698799:0:15522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787580203.698801:0:15522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787580203.698803:0:15522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787580203.706626:0:15079:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787580203.706646:0:15079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f9212c2/0xc86deac208338a26 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.706662:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=551s v=(0 0) 00010000:00010000:3.0:1787580203.706667:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787580203.707230:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787580203.707632:0:15079:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f9212c2/0xc86deac208338a26 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.708016:0:15079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f9212c2/0xc86deac208338a26 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.708041:0:15079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f9212c2/0xc86deac208338a26 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.708049:0:15079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004f9212c2/0xc86deac208338a26 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.708089:0:15079:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787580203.708100:0:14383:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787580203.708105:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004f9212c2/0xc86deac208338a26 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.708113:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae40030000 already unused, calling callback (ffffffffc155a230) 00010000:00010000:3.0:1787580203.708117:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004f9212c2/0xc86deac208338a26 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.708127:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004f9212c2/0xc86deac208338a26 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.708144:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004f9212c2/0xc86deac208338a26 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.708152:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f9212c2/0xc86deac208338a26 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.708171:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787580203.708178:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787580203.708180:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787580203.709081:0:15079:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787580203.709090:0:15079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d619b7f2/0xc86deac208338a2d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.709102:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=551s v=(0 0) 00010000:00010000:3.0:1787580203.709107:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787580203.709113:0:15079:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d619b7f2/0xc86deac208338a2d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.709123:0:15079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d619b7f2/0xc86deac208338a2d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.709130:0:15079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d619b7f2/0xc86deac208338a2d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.709137:0:15079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d619b7f2/0xc86deac208338a2d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.709159:0:15079:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787580203.709170:0:15522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787580203.709174:0:15522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d619b7f2/0xc86deac208338a2d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.709181:0:15522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae40030a00 already unused, calling callback (ffffffffc155a230) 00010000:00010000:3.0:1787580203.709184:0:15522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d619b7f2/0xc86deac208338a2d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.709203:0:15522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d619b7f2/0xc86deac208338a2d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.709213:0:15522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d619b7f2/0xc86deac208338a2d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.709220:0:15522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d619b7f2/0xc86deac208338a2d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.709235:0:15522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787580203.709236:0:15522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787580203.709238:0:15522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787580203.713844:0:15079:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787580203.713856:0:15079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c48310ce/0xc86deac208338a34 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.713874:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=551s v=(0 0) 00010000:00010000:3.0:1787580203.713879:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787580203.713885:0:15079:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c48310ce/0xc86deac208338a34 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.713897:0:15079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c48310ce/0xc86deac208338a34 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.713907:0:15079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c48310ce/0xc86deac208338a34 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.713923:0:15079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c48310ce/0xc86deac208338a34 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.713940:0:15079:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787580203.714441:0:15079:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787580203.714448:0:15079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000033365d4a/0xc86deac208338a3b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.714456:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=551s v=(0 0) 00010000:00010000:3.0:1787580203.714459:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787580203.714463:0:15079:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000033365d4a/0xc86deac208338a3b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.714471:0:15079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000033365d4a/0xc86deac208338a3b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.714479:0:15079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000033365d4a/0xc86deac208338a3b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.714486:0:15079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000033365d4a/0xc86deac208338a3b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.714499:0:15079:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787580203.714508:0:14383:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787580203.714513:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c48310ce/0xc86deac208338a34 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.714526:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae40031a00 already unused, calling callback (ffffffffc155a230) 00010000:00010000:3.0:1787580203.714530:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c48310ce/0xc86deac208338a34 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.714538:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c48310ce/0xc86deac208338a34 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.714552:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c48310ce/0xc86deac208338a34 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.714559:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c48310ce/0xc86deac208338a34 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.714576:0:14383:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787580203.714580:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000033365d4a/0xc86deac208338a3b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.714587:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae40030400 already unused, calling callback (ffffffffc155a230) 00010000:00010000:3.0:1787580203.714590:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000033365d4a/0xc86deac208338a3b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.714597:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000033365d4a/0xc86deac208338a3b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.714606:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000033365d4a/0xc86deac208338a3b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.714619:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000033365d4a/0xc86deac208338a3b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.714633:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787580203.714635:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787580203.714637:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787580203.717366:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787580203.724135:0:15079:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787580203.724156:0:15079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1e7d2fc/0xc86deac208338a42 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.724176:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=551s v=(0 0) 00010000:00010000:3.0:1787580203.724181:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787580203.724189:0:15079:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1e7d2fc/0xc86deac208338a42 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.724206:0:15079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1e7d2fc/0xc86deac208338a42 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.724218:0:15079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1e7d2fc/0xc86deac208338a42 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.724228:0:15079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1e7d2fc/0xc86deac208338a42 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.724249:0:15079:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787580203.724269:0:15522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787580203.724286:0:15522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1e7d2fc/0xc86deac208338a42 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.724293:0:15522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae40031000 already unused, calling callback (ffffffffc155a230) 00010000:00010000:3.0:1787580203.724297:0:15522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1e7d2fc/0xc86deac208338a42 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.724306:0:15522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1e7d2fc/0xc86deac208338a42 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.724325:0:15522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1e7d2fc/0xc86deac208338a42 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.724334:0:15522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1e7d2fc/0xc86deac208338a42 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.724359:0:15522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787580203.724361:0:15522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787580203.724362:0:15522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787580203.729153:0:15079:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787580203.729166:0:15079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a6998ca/0xc86deac208338a49 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.729183:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=551s v=(0 0) 00010000:00010000:3.0:1787580203.729188:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787580203.729194:0:15079:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a6998ca/0xc86deac208338a49 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.729221:0:15079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008a6998ca/0xc86deac208338a49 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.729233:0:15079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a6998ca/0xc86deac208338a49 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.729241:0:15079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008a6998ca/0xc86deac208338a49 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.729264:0:15079:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787580203.729278:0:14383:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787580203.729284:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008a6998ca/0xc86deac208338a49 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.729293:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae5f6d6a00 already unused, calling callback (ffffffffc155a230) 00010000:00010000:3.0:1787580203.729298:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008a6998ca/0xc86deac208338a49 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.729308:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008a6998ca/0xc86deac208338a49 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.729325:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008a6998ca/0xc86deac208338a49 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.729333:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008a6998ca/0xc86deac208338a49 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.729356:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787580203.729358:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787580203.729360:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787580203.734438:0:15079:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787580203.734452:0:15079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024ec28a2/0xc86deac208338a50 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.734469:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=551s v=(0 0) 00010000:00010000:3.0:1787580203.734474:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787580203.734481:0:15079:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024ec28a2/0xc86deac208338a50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.734495:0:15079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000024ec28a2/0xc86deac208338a50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.734506:0:15079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024ec28a2/0xc86deac208338a50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.734514:0:15079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000024ec28a2/0xc86deac208338a50 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.734531:0:15079:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787580203.735032:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787580203.735041:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000024ec28a2/0xc86deac208338a50 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580203.735050:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae5f6d7200 already unused, calling callback (ffffffffc155a230) 00010000:00010000:0.0:1787580203.735056:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000024ec28a2/0xc86deac208338a50 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580203.735066:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000024ec28a2/0xc86deac208338a50 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580203.735088:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000024ec28a2/0xc86deac208338a50 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580203.735096:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000024ec28a2/0xc86deac208338a50 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580203.735117:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787580203.735119:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787580203.735120:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787580203.738364:0:15079:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787580203.738378:0:15079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000607b5f73/0xc86deac208338a57 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.738441:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=551s v=(0 0) 00010000:00010000:3.0:1787580203.738445:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787580203.738451:0:15079:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000607b5f73/0xc86deac208338a57 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.738464:0:15079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000607b5f73/0xc86deac208338a57 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.738473:0:15079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000607b5f73/0xc86deac208338a57 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.738480:0:15079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000607b5f73/0xc86deac208338a57 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.738515:0:15079:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787580203.738527:0:15522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787580203.738532:0:15522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000607b5f73/0xc86deac208338a57 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.738539:0:15522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae5f6d6800 already unused, calling callback (ffffffffc155a230) 00010000:00010000:3.0:1787580203.738544:0:15522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000607b5f73/0xc86deac208338a57 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.738553:0:15522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000607b5f73/0xc86deac208338a57 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.738580:0:15522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000607b5f73/0xc86deac208338a57 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.738588:0:15522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000607b5f73/0xc86deac208338a57 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.738620:0:15522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787580203.738622:0:15522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787580203.738624:0:15522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787580203.742534:0:15079:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787580203.742546:0:15079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a6998ca/0xc86deac208338a5e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.742562:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=551s v=(0 0) 00010000:00010000:3.0:1787580203.742567:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787580203.742574:0:15079:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a6998ca/0xc86deac208338a5e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.742588:0:15079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008a6998ca/0xc86deac208338a5e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.742598:0:15079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a6998ca/0xc86deac208338a5e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.742604:0:15079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008a6998ca/0xc86deac208338a5e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.742656:0:15079:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787580203.742986:0:14383:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787580203.742995:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008a6998ca/0xc86deac208338a5e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580203.743003:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae5f6d6a00 already unused, calling callback (ffffffffc155a230) 00010000:00010000:0.0:1787580203.743015:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008a6998ca/0xc86deac208338a5e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580203.743025:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008a6998ca/0xc86deac208338a5e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580203.743043:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008a6998ca/0xc86deac208338a5e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580203.743050:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008a6998ca/0xc86deac208338a5e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580203.743066:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787580203.743068:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787580203.743070:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787580203.746586:0:15079:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787580203.746611:0:15079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000607b5f73/0xc86deac208338a65 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.746630:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=551s v=(0 0) 00010000:00010000:3.0:1787580203.746636:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787580203.746649:0:15079:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000607b5f73/0xc86deac208338a65 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.746663:0:15079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000607b5f73/0xc86deac208338a65 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.752864:0:15079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000607b5f73/0xc86deac208338a65 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.752889:0:15079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000607b5f73/0xc86deac208338a65 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.752931:0:15079:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787580203.754682:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787580203.754695:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000607b5f73/0xc86deac208338a65 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580203.754708:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae5f6d6800 already unused, calling callback (ffffffffc155a230) 00010000:00010000:0.0:1787580203.754713:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000607b5f73/0xc86deac208338a65 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580203.754723:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000607b5f73/0xc86deac208338a65 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580203.754744:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000607b5f73/0xc86deac208338a65 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580203.754762:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000607b5f73/0xc86deac208338a65 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580203.754791:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787580203.754793:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787580203.754794:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787580203.755292:0:7653:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:3.0:1787580203.755902:0:15079:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787580203.755911:0:15079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a4c0f800/0xc86deac208338a6c lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.755924:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=551s v=(0 0) 00010000:00010000:3.0:1787580203.755934:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787580203.755941:0:15079:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a4c0f800/0xc86deac208338a6c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.755955:0:15079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a4c0f800/0xc86deac208338a6c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.755965:0:15079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a4c0f800/0xc86deac208338a6c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.755973:0:15079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a4c0f800/0xc86deac208338a6c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.759834:0:15079:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787580203.760453:0:15079:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787580203.760463:0:15079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3e03c02/0xc86deac208338a73 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.760480:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=551s v=(0 0) 00010000:00010000:3.0:1787580203.760485:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787580203.760492:0:15079:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a3e03c02/0xc86deac208338a73 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.760505:0:15079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a3e03c02/0xc86deac208338a73 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.760515:0:15079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3e03c02/0xc86deac208338a73 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.760530:0:15079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a3e03c02/0xc86deac208338a73 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787580203.761203:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:0.0:1787580203.761279:0:15522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787580203.761288:0:15522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a4c0f800/0xc86deac208338a6c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580203.761298:0:15522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae5f6d6600 already unused, calling callback (ffffffffc155a230) 00010000:00010000:0.0:1787580203.761305:0:15522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4c0f800/0xc86deac208338a6c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580203.761315:0:15522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4c0f800/0xc86deac208338a6c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580203.761335:0:15522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a4c0f800/0xc86deac208338a6c lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580203.761343:0:15522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a4c0f800/0xc86deac208338a6c lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580203.761361:0:15522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787580203.761365:0:15522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a3e03c02/0xc86deac208338a73 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580203.761447:0:15522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae5f6d6400 already unused, calling callback (ffffffffc155a230) 00010000:00010000:0.0:1787580203.761451:0:15522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3e03c02/0xc86deac208338a73 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580203.761460:0:15522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3e03c02/0xc86deac208338a73 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580203.761470:0:15522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a3e03c02/0xc86deac208338a73 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.761573:0:15079:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787580203.761579:0:15079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a3e03c02/0xc86deac208338a73 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787580203.762182:0:15079:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787580203.762190:0:15079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f4114af/0xc86deac208338a7a lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.762200:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=551s v=(0 0) 00010000:00010000:3.0:1787580203.762204:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787580203.762209:0:15079:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f4114af/0xc86deac208338a7a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.762219:0:15079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001f4114af/0xc86deac208338a7a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.762227:0:15079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f4114af/0xc86deac208338a7a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.762234:0:15079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001f4114af/0xc86deac208338a7a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.762260:0:15079:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787580203.762684:0:15079:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787580203.762690:0:15079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000947b83b6/0xc86deac208338a81 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.762698:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=551s v=(0 0) 00010000:00010000:3.0:1787580203.762701:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787580203.762706:0:15079:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000947b83b6/0xc86deac208338a81 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.762714:0:15079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000947b83b6/0xc86deac208338a81 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.762722:0:15079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000947b83b6/0xc86deac208338a81 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.762729:0:15079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000947b83b6/0xc86deac208338a81 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.762738:0:15079:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1787580203.763103:0:15079:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787580203.763109:0:15079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a6998ca/0xc86deac208338a88 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.763116:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=551s v=(0 0) 00010000:00010000:3.0:1787580203.763125:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787580203.763130:0:15079:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a6998ca/0xc86deac208338a88 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.763139:0:15079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008a6998ca/0xc86deac208338a88 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.763146:0:15079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a6998ca/0xc86deac208338a88 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.763153:0:15079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008a6998ca/0xc86deac208338a88 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.763161:0:15079:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1787580203.763559:0:15079:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787580203.763567:0:15079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024ec28a2/0xc86deac208338a8f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.763576:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=551s v=(0 0) 00010000:00010000:3.0:1787580203.763579:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787580203.763583:0:15079:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024ec28a2/0xc86deac208338a8f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.763593:0:15079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000024ec28a2/0xc86deac208338a8f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.763603:0:15079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024ec28a2/0xc86deac208338a8f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.763616:0:15079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000024ec28a2/0xc86deac208338a8f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.763624:0:15079:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1787580203.763996:0:15079:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787580203.764002:0:15079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000491189dc/0xc86deac208338a96 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.764011:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=551s v=(0 0) 00010000:00010000:3.0:1787580203.764014:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787580203.764018:0:15079:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000491189dc/0xc86deac208338a96 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.764028:0:15079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000491189dc/0xc86deac208338a96 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.764037:0:15079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000491189dc/0xc86deac208338a96 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.764045:0:15079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000491189dc/0xc86deac208338a96 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.764053:0:15079:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:3.0:1787580203.764471:0:15079:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787580203.764478:0:15079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003385f6a6/0xc86deac208338a9d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.764493:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=551s v=(0 0) 00010000:00010000:3.0:1787580203.764496:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787580203.764500:0:15079:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003385f6a6/0xc86deac208338a9d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.764510:0:15079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003385f6a6/0xc86deac208338a9d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.764518:0:15079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003385f6a6/0xc86deac208338a9d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.764526:0:15079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003385f6a6/0xc86deac208338a9d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580203.764534:0:15079:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00080000:3.0:1787580203.764672:0:15079:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:3.0:1787580203.764760:0:15079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae507b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:14420:x1874413262837376:12345-0@lo:5:osp-pre-1-0.0 Request processed in 124114us (125383us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580203.764770:0:15079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:0.0:1787580203.764913:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1787580203.764922:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001f4114af/0xc86deac208338a7a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580203.764931:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae5f6d6c00 already unused, calling callback (ffffffffc155a230) 00010000:00010000:0.0:1787580203.764936:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001f4114af/0xc86deac208338a7a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580203.764946:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001f4114af/0xc86deac208338a7a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580203.764963:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001f4114af/0xc86deac208338a7a lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580203.764971:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001f4114af/0xc86deac208338a7a lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580203.765000:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1787580203.765004:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000947b83b6/0xc86deac208338a81 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580203.765010:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae5f6d7000 already unused, calling callback (ffffffffc155a230) 00010000:00010000:0.0:1787580203.765014:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000947b83b6/0xc86deac208338a81 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580203.765021:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000947b83b6/0xc86deac208338a81 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580203.765030:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000947b83b6/0xc86deac208338a81 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580203.765037:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000947b83b6/0xc86deac208338a81 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580203.765046:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1787580203.765049:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008a6998ca/0xc86deac208338a88 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580203.765056:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae5f6d6a00 already unused, calling callback (ffffffffc155a230) 00010000:00010000:0.0:1787580203.765059:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008a6998ca/0xc86deac208338a88 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580203.765076:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008a6998ca/0xc86deac208338a88 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580203.765085:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008a6998ca/0xc86deac208338a88 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580203.765093:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008a6998ca/0xc86deac208338a88 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580203.765106:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787580203.765113:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000024ec28a2/0xc86deac208338a8f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580203.765119:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae5f6d7200 already unused, calling callback (ffffffffc155a230) 00010000:00010000:0.0:1787580203.765122:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000024ec28a2/0xc86deac208338a8f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580203.765129:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000024ec28a2/0xc86deac208338a8f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580203.765137:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000024ec28a2/0xc86deac208338a8f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580203.765144:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000024ec28a2/0xc86deac208338a8f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580203.765166:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787580203.765170:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000491189dc/0xc86deac208338a96 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580203.765176:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae5f6d7a00 already unused, calling callback (ffffffffc155a230) 00010000:00010000:0.0:1787580203.765180:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000491189dc/0xc86deac208338a96 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580203.765186:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000491189dc/0xc86deac208338a96 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580203.765196:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000491189dc/0xc86deac208338a96 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580203.765204:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000491189dc/0xc86deac208338a96 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580203.765214:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787580203.765217:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003385f6a6/0xc86deac208338a9d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580203.765223:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae4150fc00 already unused, calling callback (ffffffffc155a230) 00010000:00010000:0.0:1787580203.765226:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003385f6a6/0xc86deac208338a9d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580203.765244:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003385f6a6/0xc86deac208338a9d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580203.765254:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003385f6a6/0xc86deac208338a9d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580203.765261:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003385f6a6/0xc86deac208338a9d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580203.765274:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787580203.765276:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787580203.765277:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787580203.765286:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787580203.765462:0:14420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae507bb480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14420:1874413262837376:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1787580203.765478:0:14420:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:0.0:1787580203.765522:0:14420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7ec35c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14420:1874413262837504:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1787580203.765559:0:14420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580203.765590:0:14420:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae779f3180 going to sleep for 11 seconds 00010000:00010000:1.0:1787580203.767573:0:15522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787580203.767579:0:15522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787580203.767582:0:15522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787580203.769823:0:15080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262837504 00000100:00100000:3.0:1787580203.769839:0:15080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262837504 00000100:00100000:3.0:1787580203.769905:0:15080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787580203.769916:0:15080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7ec36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:14420:x1874413262837504:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1787580203.769986:0:15080:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:3.0:1787580203.778972:0:15080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7ec36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14420:x1874413262837504:12345-0@lo:5:osp-pre-1-0.0 Request processed in 9048us (13402us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1787580203.778997:0:15080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787580203.779214:0:14420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7ec35c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14420:1874413262837504:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1787580203.779231:0:14420:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:1.0:1787580204.275503:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787580205.033157:0:16156:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg236-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787580205.299577:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787580206.344664:0:15522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787580207.348450:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787580207.806549:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580207.806940:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239772288 00000100:00100000:3.0:1787580207.806953:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239772288 00000100:00100000:3.0:1787580207.807007:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 75 00000100:00100000:3.0:1787580207.807017:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d517c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2357:x1874413239772288:12345-192.168.202.36@tcp:250:mount.lustre.0 00010000:00080000:3.0:1787580207.807048:0:14390:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 3458fe6f-27ac-41dd-98c0-57097478e8b1@192.168.202.36@tcp t0 exp 0000000000000000 cur 555 last 0 00000020:00000080:3.0:1787580207.807079:0:14390:0:(genops.c:1385:class_connect()) connect: client 3458fe6f-27ac-41dd-98c0-57097478e8b1, cookie 0xc86deac208338aa4 00000100:00080000:3.0:1787580207.807268:0:14390:0:(import.c:65:import_set_state_nolock()) ffff8fad412a6800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787580207.807363:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d517c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3458fe6f-27ac-41dd-98c0-57097478e8b1+5:2357:x1874413239772288:12345-192.168.202.36@tcp:250:mount.lustre.0 Request processed in 346us (824us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580207.807372:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 75 00000100:00100000:3.0:1787580207.811610:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580207.811691:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239772416 00000100:00100000:0.0:1787580207.811704:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239772416 00000100:00100000:0.0:1787580207.811775:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 76 00000100:00100000:0.0:1787580207.811788:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d515450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3458fe6f-27ac-41dd-98c0-57097478e8b1+5:13802:x1874413239772416:12345-192.168.202.36@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787580207.811809:0:14388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787580207.811860:0:14388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fae50febc00/0xc86deac208338aab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d472 expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580207.811897:0:14388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fae50febc00/0xc86deac208338aab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d472 expref: 6 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580207.811911:0:14388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fae50febc00/0xc86deac208338aab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d472 expref: 6 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580207.811922:0:14388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae50febc00, rc 0) 00000100:00100000:0.0:1787580207.812007:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d515450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3458fe6f-27ac-41dd-98c0-57097478e8b1+6:13802:x1874413239772416:12345-192.168.202.36@tcp:101:mount.lustre.0 Request processed in 221us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580207.812014:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 76 00000100:00100000:0.0:1787580207.832557:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580207.832671:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239772544 00000100:00100000:1.0:1787580207.832683:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239772544 00000100:00100000:1.0:1787580207.832752:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 77 00000100:00100000:1.0:1787580207.832764:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d514450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3458fe6f-27ac-41dd-98c0-57097478e8b1+6:13802:x1874413239772544:12345-192.168.202.36@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787580207.833303:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d514450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3458fe6f-27ac-41dd-98c0-57097478e8b1+6:13802:x1874413239772544:12345-192.168.202.36@tcp:501:mount.lustre.0 Request processed in 538us (754us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787580207.833313:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 77 00000100:00100000:3.0:1787580207.839608:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580207.839721:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239772672 00000100:00100000:0.0:1787580207.839731:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239772672 00000100:00100000:0.0:1787580207.839803:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 78 00000100:00100000:0.0:1787580207.839815:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d514050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3458fe6f-27ac-41dd-98c0-57097478e8b1+6:13802:x1874413239772672:12345-192.168.202.36@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787580207.839834:0:14388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787580207.839858:0:14388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fae50feaa00/0xc86deac208338ab2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d479 expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580207.839892:0:14388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fae50feaa00/0xc86deac208338ab2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d479 expref: 7 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580207.839903:0:14388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fae50feaa00/0xc86deac208338ab2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d479 expref: 7 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580207.839912:0:14388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae50feaa00, rc 0) 00000100:00100000:0.0:1787580207.840015:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d514050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3458fe6f-27ac-41dd-98c0-57097478e8b1+7:13802:x1874413239772672:12345-192.168.202.36@tcp:101:mount.lustre.0 Request processed in 202us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580207.840024:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 78 00000100:00100000:3.0:1787580207.847918:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580207.848271:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239772800 00000100:00100000:1.0:1787580207.848284:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239772800 00000100:00100000:1.0:1787580207.848439:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 79 00000100:00100000:1.0:1787580207.848450:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3458fe6f-27ac-41dd-98c0-57097478e8b1+7:13802:x1874413239772800:12345-192.168.202.36@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787580207.848783:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3458fe6f-27ac-41dd-98c0-57097478e8b1+8:13802:x1874413239772800:12345-192.168.202.36@tcp:501:mount.lustre.0 Request processed in 334us (875us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580207.848791:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 79 00000100:00100000:3.0:1787580207.851967:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580207.864631:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239772928 00000100:00100000:0.0:1787580207.864651:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239772928 00000100:00100000:2.0:1787580207.864789:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 80 00000100:00100000:2.0:1787580207.864808:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3458fe6f-27ac-41dd-98c0-57097478e8b1+8:13802:x1874413239772928:12345-192.168.202.36@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787580207.868035:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3458fe6f-27ac-41dd-98c0-57097478e8b1+8:13802:x1874413239772928:12345-192.168.202.36@tcp:503:mount.lustre.0 Request processed in 3221us (16064us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580207.868051:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 80 00000100:00100000:3.0:1787580207.884789:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580207.886155:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239773056 00000100:00100000:0.0:1787580207.886172:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239773056 00000100:00100000:0.0:1787580207.886268:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 81 00000100:00100000:0.0:1787580207.886279:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3458fe6f-27ac-41dd-98c0-57097478e8b1+8:13821:x1874413239773056:12345-192.168.202.36@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787580207.887891:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3458fe6f-27ac-41dd-98c0-57097478e8b1+8:13821:x1874413239773056:12345-192.168.202.36@tcp:502:llog_process_th.0 Request processed in 1600us (3101us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580207.887907:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 81 00000100:00100000:2.0:1787580207.907796:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580207.907993:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239773184 00000100:00100000:3.0:1787580207.908005:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239773184 00000100:00100000:3.0:1787580207.908075:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 82 00000100:00100000:3.0:1787580207.908098:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3458fe6f-27ac-41dd-98c0-57097478e8b1+8:13821:x1874413239773184:12345-192.168.202.36@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787580207.908860:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3458fe6f-27ac-41dd-98c0-57097478e8b1+8:13821:x1874413239773184:12345-192.168.202.36@tcp:502:llog_process_th.0 Request processed in 770us (1071us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580207.908871:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 82 00000100:00100000:2.0:1787580207.929475:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580207.930007:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239773312 00000100:00100000:3.0:1787580207.930031:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239773312 00000100:00100000:3.0:1787580207.930095:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 83 00000100:00100000:3.0:1787580207.930106:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3458fe6f-27ac-41dd-98c0-57097478e8b1+8:13802:x1874413239773312:12345-192.168.202.36@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787580207.930126:0:14389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787580207.930147:0:14389:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fae4150f600/0xc86deac208338ab9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d4a3 expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580207.930180:0:14389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fae4150f600/0xc86deac208338ab9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d4a3 expref: 9 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580207.930191:0:14389:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fae4150f600/0xc86deac208338ab9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d4a3 expref: 9 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580207.930201:0:14389:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae4150f600, rc 0) 00000100:00100000:3.0:1787580207.930281:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3458fe6f-27ac-41dd-98c0-57097478e8b1+9:13802:x1874413239773312:12345-192.168.202.36@tcp:101:mount.lustre.0 Request processed in 176us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580207.930288:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 83 00000100:00100000:0.0:1787580207.934905:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580207.935049:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239773440 00000100:00100000:3.0:1787580207.935060:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239773440 00000100:00100000:3.0:1787580207.935131:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 84 00000100:00100000:3.0:1787580207.935143:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3458fe6f-27ac-41dd-98c0-57097478e8b1+9:13802:x1874413239773440:12345-192.168.202.36@tcp:256:mount.lustre.0 20000000:01000000:3.0:1787580207.935171:0:14390:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1787580207.935200:0:14390:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787580207.935205:0:14390:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1787580207.935208:0:14390:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1787580207.935211:0:14390:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:3.0:1787580207.940976:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3458fe6f-27ac-41dd-98c0-57097478e8b1+9:13802:x1874413239773440:12345-192.168.202.36@tcp:256:mount.lustre.0 Request processed in 5822us (6068us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580207.940992:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 84 00000100:00100000:2.0:1787580207.948921:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580207.949003:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239773568 00000100:00100000:0.0:1787580207.949012:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239773568 00000100:00100000:0.0:1787580207.949059:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 85 00000100:00100000:0.0:1787580207.949070:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3458fe6f-27ac-41dd-98c0-57097478e8b1+9:13802:x1874413239773568:12345-192.168.202.36@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787580207.949088:0:14388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787580207.949111:0:14388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fae50feb800/0xc86deac208338ac0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d4aa expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580207.949143:0:14388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fae50feb800/0xc86deac208338ac0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d4aa expref: 10 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580207.949155:0:14388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fae50feb800/0xc86deac208338ac0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d4aa expref: 10 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580207.949166:0:14388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae50feb800, rc 0) 00000100:00100000:0.0:1787580207.949224:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3458fe6f-27ac-41dd-98c0-57097478e8b1+10:13802:x1874413239773568:12345-192.168.202.36@tcp:101:mount.lustre.0 Request processed in 157us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580207.949229:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 85 00000100:00100000:0.0:1787580207.951139:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580207.951237:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239773696 00000100:00100000:3.0:1787580207.951257:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239773696 00000100:00100000:3.0:1787580207.951317:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 86 00000100:00100000:3.0:1787580207.951324:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3458fe6f-27ac-41dd-98c0-57097478e8b1+10:13802:x1874413239773696:12345-192.168.202.36@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787580207.951668:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3458fe6f-27ac-41dd-98c0-57097478e8b1+10:13802:x1874413239773696:12345-192.168.202.36@tcp:501:mount.lustre.0 Request processed in 342us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580207.951687:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 86 00000100:00100000:0.0:1787580207.959047:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580207.959191:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239773824 00000100:00100000:3.0:1787580207.959203:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239773824 00000100:00100000:3.0:1787580207.959276:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 87 00000100:00100000:3.0:1787580207.959286:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3458fe6f-27ac-41dd-98c0-57097478e8b1+10:13802:x1874413239773824:12345-192.168.202.36@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787580207.959784:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3458fe6f-27ac-41dd-98c0-57097478e8b1+10:13802:x1874413239773824:12345-192.168.202.36@tcp:503:mount.lustre.0 Request processed in 498us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580207.959793:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 87 00000100:00100000:2.0:1787580207.963873:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580207.964835:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239773952 00000100:00100000:0.0:1787580207.964848:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239773952 00000100:00100000:0.0:1787580207.964908:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 88 00000100:00100000:0.0:1787580207.964918:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3458fe6f-27ac-41dd-98c0-57097478e8b1+10:13825:x1874413239773952:12345-192.168.202.36@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787580207.965185:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3458fe6f-27ac-41dd-98c0-57097478e8b1+10:13825:x1874413239773952:12345-192.168.202.36@tcp:502:llog_process_th.0 Request processed in 267us (1323us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580207.965194:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 88 00000100:00100000:0.0:1787580207.977208:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580207.977503:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239774080 00000100:00100000:3.0:1787580207.977514:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239774080 00000100:00100000:3.0:1787580207.977584:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 89 00000100:00100000:3.0:1787580207.977596:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3458fe6f-27ac-41dd-98c0-57097478e8b1+10:13825:x1874413239774080:12345-192.168.202.36@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787580207.978052:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3458fe6f-27ac-41dd-98c0-57097478e8b1+10:13825:x1874413239774080:12345-192.168.202.36@tcp:502:llog_process_th.0 Request processed in 457us (855us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580207.978061:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 89 00000100:00100000:2.0:1787580207.991974:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580207.996771:0:15103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239774208 00000100:00100000:1.0:1787580207.996786:0:15103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239774208 00000100:00100000:0.0:1787580208.001620:0:15103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 4 00000100:00100000:0.0:1787580208.001633:0:15103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d5bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2357:x1874413239774208:12345-192.168.202.36@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787580208.001676:0:15103:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 1a27ab63-1899-406a-bdda-fd6b0377149d@192.168.202.36@tcp t0 exp 0000000000000000 cur 555 last 0 00000020:00000080:0.0:1787580208.001729:0:15103:0:(genops.c:1385:class_connect()) connect: client 1a27ab63-1899-406a-bdda-fd6b0377149d, cookie 0xc86deac208338ac7 00000004:00100000:0.0:1787580208.001772:0:15103:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1787580208.001778:0:15103:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:1.0:1787580208.125169:0:15103:0:(import.c:65:import_set_state_nolock()) ffff8fad42d15800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787580208.125279:0:15103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d5bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a27ab63-1899-406a-bdda-fd6b0377149d+6:2357:x1874413239774208:12345-192.168.202.36@tcp:38:mount.lustre.0 Request processed in 123645us (133316us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580208.125292:0:15103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 4 00000100:00100000:1.0:1787580208.128710:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580208.128821:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239774464 00000100:00100000:3.0:1787580208.128834:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239774464 00000100:00100000:3.0:1787580208.128922:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 5 00000100:00100000:3.0:1787580208.128933:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae50728000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a27ab63-1899-406a-bdda-fd6b0377149d+6:13802:x1874413239774464:12345-192.168.202.36@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787580208.128996:0:14395:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787580208.129086:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae50728000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a27ab63-1899-406a-bdda-fd6b0377149d+6:13802:x1874413239774464:12345-192.168.202.36@tcp:41:mount.lustre.0 Request processed in 155us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580208.129094:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 5 00000100:00080000:1.0:1787580208.129167:0:14391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787580208.134773:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580208.137202:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239774336 00000100:00100000:3.0:1787580208.137217:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239774336 00000100:00100000:3.0:1787580208.137292:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 6 00000100:00100000:3.0:1787580208.137303:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d5bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a27ab63-1899-406a-bdda-fd6b0377149d+6:0:x1874413239774336:12345-192.168.202.36@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787580208.137335:0:14396:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787580208.137444:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d5bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a27ab63-1899-406a-bdda-fd6b0377149d+6:0:x1874413239774336:12345-192.168.202.36@tcp:41:mount.lustre.0 Request processed in 142us (2686us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580208.137452:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 6 00000100:00100000:2.0:1787580208.137698:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580208.142239:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239774592 00000100:00100000:3.0:1787580208.142257:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239774592 00000100:00100000:3.0:1787580208.142332:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 7 00000100:00100000:3.0:1787580208.142344:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d5b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a27ab63-1899-406a-bdda-fd6b0377149d+6:13802:x1874413239774592:12345-192.168.202.36@tcp:40:mount.lustre.0 00000100:00100000:3.0:1787580208.142470:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d5b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a27ab63-1899-406a-bdda-fd6b0377149d+6:13802:x1874413239774592:12345-192.168.202.36@tcp:40:mount.lustre.0 Request processed in 128us (4772us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580208.142478:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 7 00000100:00100000:2.0:1787580208.145785:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580208.145838:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580208.145877:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580208.145978:0:15078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239774720 00000100:00100000:1.0:1787580208.145988:0:15078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239774720 00000100:00100000:1.0:1787580208.146042:0:15078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239774848 00000100:00100000:1.0:1787580208.146046:0:15078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239774848 00000100:00100000:1.0:1787580208.146063:0:15078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 9 00000100:00100000:1.0:1787580208.146072:0:15078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d5b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2357:x1874413239774720:12345-192.168.202.36@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787580208.146104:0:15078:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 1a27ab63-1899-406a-bdda-fd6b0377149d@192.168.202.36@tcp t0 exp 0000000000000000 cur 555 last 0 00000020:00000080:1.0:1787580208.146138:0:15078:0:(genops.c:1385:class_connect()) connect: client 1a27ab63-1899-406a-bdda-fd6b0377149d, cookie 0xc86deac208338ace 00002000:00100000:1.0:1787580208.146151:0:15078:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 1a27ab63-1899-406a-bdda-fd6b0377149d/ffff8fad42d16800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787580208.146178:0:15078:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787580208.146587:0:15078:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787580208.146621:0:15078:0:(import.c:65:import_set_state_nolock()) ffff8fad42d10000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787580208.146693:0:15078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d5b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1a27ab63-1899-406a-bdda-fd6b0377149d+6:2357:x1874413239774720:12345-192.168.202.36@tcp:8:mount.lustre.0 Request processed in 619us (853us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580208.146702:0:15078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 9 00000100:00100000:1.0:1787580208.146724:0:15078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 10 00000100:00100000:1.0:1787580208.146730:0:15078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d5b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2357:x1874413239774848:12345-192.168.202.36@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787580208.146760:0:15078:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 1a27ab63-1899-406a-bdda-fd6b0377149d@192.168.202.36@tcp t0 exp 0000000000000000 cur 555 last 0 00000020:00000080:1.0:1787580208.146797:0:15078:0:(genops.c:1385:class_connect()) connect: client 1a27ab63-1899-406a-bdda-fd6b0377149d, cookie 0xc86deac208338ad5 00002000:00100000:1.0:1787580208.146803:0:15078:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 1a27ab63-1899-406a-bdda-fd6b0377149d/ffff8fad42d13000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787580208.146820:0:15078:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787580208.146956:0:15078:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787580208.146992:0:15078:0:(import.c:65:import_set_state_nolock()) ffff8fae50f70800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787580208.147200:0:15078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d5b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1a27ab63-1899-406a-bdda-fd6b0377149d+6:2357:x1874413239774848:12345-192.168.202.36@tcp:8:mount.lustre.0 Request processed in 288us (1141us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580208.147209:0:15078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 10 00000100:00100000:0.0:1787580208.147546:0:14398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239774976 00000100:00100000:0.0:1787580208.147553:0:14398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239774976 00000100:00100000:0.0:1787580208.147597:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 0 00000100:00100000:0.0:1787580208.147606:0:14398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d5ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a27ab63-1899-406a-bdda-fd6b0377149d+6:13802:x1874413239774976:12345-192.168.202.36@tcp:33:mount.lustre.0 00000004:00080000:0.0:1787580208.148344:0:14398:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 676us 00000004:00200000:0.0:1787580208.177769:0:14398:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:0.0:1787580208.177979:0:14398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d5ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a27ab63-1899-406a-bdda-fd6b0377149d+6:13802:x1874413239774976:12345-192.168.202.36@tcp:33:mount.lustre.0 Request processed in 30367us (32199us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580208.177991:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 0 00000100:00100000:0.0:1787580208.243804:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787580208.243829:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae507b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874413262837632:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787580208.243904:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580208.244104:0:15083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262837632 00000100:00100000:3.0:1787580208.244113:0:15083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262837632 00000100:00100000:3.0:1787580208.244185:0:15083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787580208.244196:0:15083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7ec35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874413262837632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787580208.244219:0:15083:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1787580208.244321:0:14391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787580208.244507:0:15083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7ec35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874413262837632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 311us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580208.244530:0:15083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787580208.244676:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae507b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874413262837632:0@lo:13:osp-pre-0-0.0 00000001:00100000:2.0:1787580208.311696:0:6733:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1a27ab63-1899-406a-bdda-fd6b0377149d 00010000:00010000:2.0:1787580208.374488:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787580208.463976:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580208.464076:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239775104 00000100:00100000:3.0:1787580208.464089:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239775104 00000100:00100000:3.0:1787580208.464156:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 8 00000100:00100000:3.0:1787580208.464169:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d5b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a27ab63-1899-406a-bdda-fd6b0377149d+6:13846:x1874413239775104:12345-192.168.202.36@tcp:101:mkdir.0 00010000:00010000:3.0:1787580208.464193:0:14396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787580208.464236:0:14396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150e800/0xc86deac208338adc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d4d4 expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580208.464323:0:14396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150f200/0xc86deac208338ae3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580208.464338:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150f200/0xc86deac208338ae3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580208.464364:0:14396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150f200/0xc86deac208338ae3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787580208.464926:0:14396:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787580208.464933:0:14396:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1787580208.465037:0:14396:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150f200/0xc86deac208338ae3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580208.465073:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150e800/0xc86deac208338adc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d4d4 expref: 8 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580208.465092:0:14396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150f200/0xc86deac208338ae3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d4d4 expref: 7 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580208.465113:0:14396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fae4537f300) 00010000:00010000:3.0:1787580208.465116:0:14396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787580208.465120:0:14396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae4150f200, rc 0) 00000100:00100000:3.0:1787580208.465191:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d5b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a27ab63-1899-406a-bdda-fd6b0377149d+7:13846:x1874413239775104:12345-192.168.202.36@tcp:101:mkdir.0 Request processed in 1024us (1227us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580208.465200:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 8 00000100:00100000:2.0:1787580208.755614:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5072ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874413262837760:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787580208.755688:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787580208.755839:0:15082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262837760 00000100:00100000:1.0:1787580208.755847:0:15082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262837760 00000100:00100000:1.0:1787580208.755917:0:15082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787580208.755928:0:15082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d5b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1874413262837760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787580208.755951:0:15082:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787580208.756005:0:15082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d5b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1874413262837760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580208.756011:0:15082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787580208.756055:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5072ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874413262837760:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1787580208.756090:0:14391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787580208.756351:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7ec34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5949e638-96f6-489a-aea1-b9b80ed3224f:3314:1874413262837888:0@lo:400:kworker.0 00000100:00100000:0.0:1787580208.756400:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7ec36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874413262838144:0@lo:400:kworker.0 00000100:00100000:3.0:1787580208.756421:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580208.756451:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580208.756462:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7ec35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874413262838400:0@lo:400:kworker.0 00000100:00100000:0.0:1787580208.756479:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787580208.756487:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7ec36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874413262838272:0@lo:400:kworker.0 00000100:00100000:3.0:1787580208.756499:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580208.756517:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580208.756523:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787580208.756532:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7ec34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874413262838016:0@lo:400:kworker.0 00000100:00100000:0.0:1787580208.756551:0:15103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262838144 00000100:00100000:0.0:1787580208.756556:0:15103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262838144 00000100:00100000:3.0:1787580208.756562:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580208.756594:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262837888 00000100:00100000:0.0:1787580208.756598:0:15103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262838400 00000100:00100000:3.0:1787580208.756599:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262837888 00000100:00100000:0.0:1787580208.756604:0:15103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262838400 00000100:00100000:0.0:1787580208.756625:0:15103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262838272 00000100:00100000:0.0:1787580208.756627:0:15103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262838272 00000100:00100000:0.0:1787580208.756642:0:15103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787580208.756647:0:15103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7ec35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874413262838144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787580208.756683:0:15103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7ec35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874413262838144:12345-0@lo:400:kworker.0 Request processed in 36us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580208.756690:0:15103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787580208.756703:0:15103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787580208.756709:0:15103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae507bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874413262838400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787580208.756752:0:15103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae507bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874413262838400:12345-0@lo:400:kworker.0 Request processed in 43us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580208.756758:0:15103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787580208.756789:0:15103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787580208.756801:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787580208.756801:0:15103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7ec36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874413262838272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787580208.756815:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5949e638-96f6-489a-aea1-b9b80ed3224f+19:3314:x1874413262837888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787580208.756836:0:15103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7ec36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1874413262838272:12345-0@lo:400:kworker.0 Request processed in 41us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580208.756842:0:15103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787580208.756860:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5949e638-96f6-489a-aea1-b9b80ed3224f+19:3314:x1874413262837888:12345-0@lo:400:kworker.0 Request processed in 49us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580208.756868:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787580208.756876:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7ec36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3316:1874413262838272:0@lo:400:kworker.0 00000100:00100000:0.0:1787580208.756889:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7ec36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874413262838144:0@lo:400:kworker.0 00000100:00100000:0.0:1787580208.756918:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7ec35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874413262838400:0@lo:400:kworker.0 00000100:00100000:0.0:1787580208.756927:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7ec34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5949e638-96f6-489a-aea1-b9b80ed3224f:3314:1874413262837888:0@lo:400:kworker.0 00000100:00080000:2.0:1787580208.757022:0:14391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787580208.757407:0:15078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262838016 00000100:00100000:1.0:1787580208.757413:0:15078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262838016 00000100:00100000:1.0:1787580208.757462:0:15078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787580208.757470:0:15078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae507bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874413262838016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787580208.757510:0:15078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae507bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874413262838016:12345-0@lo:400:kworker.0 Request processed in 42us (948us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580208.757517:0:15078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787580208.760135:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7ec34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874413262838016:0@lo:400:kworker.0 00000040:00080000:1.0:1787580208.820075:0:14427:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00100000:1.0:1787580208.841759:0:7653:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1a27ab63-1899-406a-bdda-fd6b0377149d 00000001:00080000:1.0:1787580208.841791:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00010000:00010000:1.0:1787580209.395559:0:15522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787580210.419506:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787580210.927419:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580210.927719:0:15103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239775232 00000100:00100000:2.0:1787580210.927730:0:15103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239775232 00000100:00100000:2.0:1787580210.927810:0:15103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 9 00000100:00100000:2.0:1787580210.927826:0:15103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae50729500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a27ab63-1899-406a-bdda-fd6b0377149d+7:13899:x1874413239775232:12345-192.168.202.36@tcp:41:lfs.0 00000004:00000024:2.0:1787580210.927877:0:15103:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787580210.927978:0:15103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae50729500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a27ab63-1899-406a-bdda-fd6b0377149d+7:13899:x1874413239775232:12345-192.168.202.36@tcp:41:lfs.0 Request processed in 157us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580210.927986:0:15103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 9 00000100:00080000:0.0:1787580210.928723:0:14391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787580210.933519:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580210.936774:0:15083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239775360 00000100:00100000:3.0:1787580210.936809:0:15083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239775360 00000100:00100000:3.0:1787580210.936988:0:15083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 6 00000100:00100000:3.0:1787580210.937000:0:15083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7ec34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1a27ab63-1899-406a-bdda-fd6b0377149d+5:13899:x1874413239775360:12345-192.168.202.36@tcp:13:lfs.0 00002000:00000024:3.0:1787580210.937043:0:15083:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787580210.937153:0:15083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7ec34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1a27ab63-1899-406a-bdda-fd6b0377149d+5:13899:x1874413239775360:12345-192.168.202.36@tcp:13:lfs.0 Request processed in 156us (3645us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580210.937162:0:15083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 6 00000100:00080000:0.0:1787580210.938073:0:14391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787580210.951360:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580210.951728:0:15082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239775488 00000100:00100000:2.0:1787580210.951739:0:15082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239775488 00000100:00100000:2.0:1787580210.951816:0:15082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 7 00000100:00100000:2.0:1787580210.951837:0:15082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5072a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1a27ab63-1899-406a-bdda-fd6b0377149d+5:13899:x1874413239775488:12345-192.168.202.36@tcp:13:lfs.0 00002000:00000024:2.0:1787580210.951879:0:15082:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787580210.951981:0:15082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5072a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1a27ab63-1899-406a-bdda-fd6b0377149d+5:13899:x1874413239775488:12345-192.168.202.36@tcp:13:lfs.0 Request processed in 147us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580210.951989:0:15082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 7 00000100:00080000:0.0:1787580210.952273:0:14391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787580211.095920:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580211.096007:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239775616 00000100:00100000:3.0:1787580211.096020:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239775616 00000100:00100000:3.0:1787580211.096089:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 91 00000100:00100000:3.0:1787580211.096099:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3458fe6f-27ac-41dd-98c0-57097478e8b1+10:13931:x1874413239775616:12345-192.168.202.36@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787580211.096117:0:14390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787580211.096135:0:14390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fae4150e800/0xc86deac208338aea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d4db expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580211.096167:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fae4150e800/0xc86deac208338aea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d4db expref: 11 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580211.096178:0:14390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fae4150e800/0xc86deac208338aea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d4db expref: 11 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580211.096187:0:14390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae4150e800, rc 0) 00000100:00100000:3.0:1787580211.096252:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3458fe6f-27ac-41dd-98c0-57097478e8b1+11:13931:x1874413239775616:12345-192.168.202.36@tcp:101:mount.lustre.0 Request processed in 154us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580211.096260:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 91 00000100:00100000:1.0:1787580211.100525:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580211.100757:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239775744 00000100:00100000:2.0:1787580211.100773:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239775744 00000100:00100000:2.0:1787580211.100922:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 92 00000100:00100000:2.0:1787580211.100933:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6e8a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3458fe6f-27ac-41dd-98c0-57097478e8b1+11:13931:x1874413239775744:12345-192.168.202.36@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787580211.101267:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6e8a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3458fe6f-27ac-41dd-98c0-57097478e8b1+11:13931:x1874413239775744:12345-192.168.202.36@tcp:501:mount.lustre.0 Request processed in 335us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580211.101276:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 92 00000100:00100000:1.0:1787580211.118240:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580211.118640:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239775872 00000100:00100000:0.0:1787580211.118653:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239775872 00000100:00100000:0.0:1787580211.118724:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 93 00000100:00100000:0.0:1787580211.118736:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6e8a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3458fe6f-27ac-41dd-98c0-57097478e8b1+11:13931:x1874413239775872:12345-192.168.202.36@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787580211.119194:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6e8a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3458fe6f-27ac-41dd-98c0-57097478e8b1+11:13931:x1874413239775872:12345-192.168.202.36@tcp:503:mount.lustre.0 Request processed in 459us (969us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580211.119204:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 93 00000100:00100000:1.0:1787580211.143322:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580211.146770:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239776000 00000100:00100000:3.0:1787580211.146790:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239776000 00000100:00100000:3.0:1787580211.146940:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 94 00000100:00100000:3.0:1787580211.146962:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6e8a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3458fe6f-27ac-41dd-98c0-57097478e8b1+11:13938:x1874413239776000:12345-192.168.202.36@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787580211.147263:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6e8a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3458fe6f-27ac-41dd-98c0-57097478e8b1+11:13938:x1874413239776000:12345-192.168.202.36@tcp:502:llog_process_th.0 Request processed in 302us (3950us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580211.147272:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 94 00000100:00100000:1.0:1787580211.173677:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580211.173788:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239776128 00000100:00100000:3.0:1787580211.173800:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239776128 00000100:00100000:3.0:1787580211.173868:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 95 00000100:00100000:3.0:1787580211.173878:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6e8a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3458fe6f-27ac-41dd-98c0-57097478e8b1+11:13938:x1874413239776128:12345-192.168.202.36@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787580211.174165:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6e8a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3458fe6f-27ac-41dd-98c0-57097478e8b1+11:13938:x1874413239776128:12345-192.168.202.36@tcp:502:llog_process_th.0 Request processed in 287us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580211.174174:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 95 00000100:00100000:1.0:1787580211.180856:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580211.180966:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239776256 00000100:00100000:0.0:1787580211.180991:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239776256 00000100:00100000:0.0:1787580211.181057:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 96 00000100:00100000:0.0:1787580211.181068:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6e8a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3458fe6f-27ac-41dd-98c0-57097478e8b1+11:13931:x1874413239776256:12345-192.168.202.36@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787580211.181101:0:14389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787580211.181120:0:14389:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fae50feac00/0xc86deac208338af1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d505 expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580211.181151:0:14389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fae50feac00/0xc86deac208338af1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d505 expref: 12 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580211.181163:0:14389:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fae50feac00/0xc86deac208338af1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d505 expref: 12 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580211.181173:0:14389:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae50feac00, rc 0) 00000100:00100000:0.0:1787580211.181238:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6e8a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3458fe6f-27ac-41dd-98c0-57097478e8b1+12:13931:x1874413239776256:12345-192.168.202.36@tcp:101:mount.lustre.0 Request processed in 171us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580211.181245:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 96 00000100:00100000:1.0:1787580211.186986:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580211.187063:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239776384 00000100:00100000:0.0:1787580211.187071:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239776384 00000100:00100000:0.0:1787580211.187117:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 97 00000100:00100000:0.0:1787580211.187127:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6e8a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3458fe6f-27ac-41dd-98c0-57097478e8b1+12:13931:x1874413239776384:12345-192.168.202.36@tcp:256:mount.lustre.0 20000000:01000000:0.0:1787580211.187154:0:14390:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787580211.187178:0:14390:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787580211.187181:0:14390:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787580211.187183:0:14390:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787580211.187184:0:14390:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1787580211.192379:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6e8a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3458fe6f-27ac-41dd-98c0-57097478e8b1+12:13931:x1874413239776384:12345-192.168.202.36@tcp:256:mount.lustre.0 Request processed in 5239us (5387us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580211.192421:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 97 00000100:00100000:0.0:1787580211.196951:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580211.197066:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239776512 00000100:00100000:3.0:1787580211.197215:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239776512 00000100:00100000:3.0:1787580211.197280:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 98 00000100:00100000:3.0:1787580211.197290:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74f08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3458fe6f-27ac-41dd-98c0-57097478e8b1+12:13931:x1874413239776512:12345-192.168.202.36@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787580211.197307:0:14389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787580211.197324:0:14389:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fae4150fa00/0xc86deac208338af8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d50c expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580211.197445:0:14389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fae4150fa00/0xc86deac208338af8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d50c expref: 13 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580211.197457:0:14389:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fae4150fa00/0xc86deac208338af8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d50c expref: 13 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580211.197467:0:14389:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae4150fa00, rc 0) 00000100:00100000:3.0:1787580211.197583:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74f08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3458fe6f-27ac-41dd-98c0-57097478e8b1+13:13931:x1874413239776512:12345-192.168.202.36@tcp:101:mount.lustre.0 Request processed in 294us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580211.197591:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 98 00000100:00100000:1.0:1787580211.203199:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580211.203321:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239776640 00000100:00100000:0.0:1787580211.203458:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239776640 00000100:00100000:0.0:1787580211.203528:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 99 00000100:00100000:0.0:1787580211.204075:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74f0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3458fe6f-27ac-41dd-98c0-57097478e8b1+13:13931:x1874413239776640:12345-192.168.202.36@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787580211.204564:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74f0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3458fe6f-27ac-41dd-98c0-57097478e8b1+13:13931:x1874413239776640:12345-192.168.202.36@tcp:501:mount.lustre.0 Request processed in 496us (1373us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580211.208247:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 99 00000100:00100000:1.0:1787580211.209448:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580211.209524:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239776768 00000100:00100000:3.0:1787580211.209544:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239776768 00000100:00100000:3.0:1787580211.209602:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 100 00000100:00100000:3.0:1787580211.209614:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74f0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3458fe6f-27ac-41dd-98c0-57097478e8b1+13:13931:x1874413239776768:12345-192.168.202.36@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787580211.209958:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74f0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3458fe6f-27ac-41dd-98c0-57097478e8b1+13:13931:x1874413239776768:12345-192.168.202.36@tcp:503:mount.lustre.0 Request processed in 343us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580211.209965:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 100 00000100:00100000:1.0:1787580211.213748:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580211.214106:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239776896 00000100:00100000:3.0:1787580211.214118:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239776896 00000100:00100000:3.0:1787580211.214190:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 101 00000100:00100000:3.0:1787580211.214204:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74f0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3458fe6f-27ac-41dd-98c0-57097478e8b1+13:13943:x1874413239776896:12345-192.168.202.36@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787580211.214510:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74f0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3458fe6f-27ac-41dd-98c0-57097478e8b1+13:13943:x1874413239776896:12345-192.168.202.36@tcp:502:llog_process_th.0 Request processed in 308us (773us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580211.214519:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 101 00000100:00100000:1.0:1787580211.240082:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580211.243469:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239777024 00000100:00100000:2.0:1787580211.243491:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239777024 00000100:00100000:2.0:1787580211.243581:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 102 00000100:00100000:2.0:1787580211.243593:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74f0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3458fe6f-27ac-41dd-98c0-57097478e8b1+13:13943:x1874413239777024:12345-192.168.202.36@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787580211.243897:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74f0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3458fe6f-27ac-41dd-98c0-57097478e8b1+13:13943:x1874413239777024:12345-192.168.202.36@tcp:502:llog_process_th.0 Request processed in 305us (3825us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580211.243907:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 102 00000100:00100000:1.0:1787580211.255806:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580211.256053:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239777152 00000100:00100000:3.0:1787580211.256064:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239777152 00000100:00100000:3.0:1787580211.256127:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 10 00000100:00100000:3.0:1787580211.256138:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae50729f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2357:x1874413239777152:12345-192.168.202.36@tcp:38:mount.lustre.0 00010000:00080000:3.0:1787580211.256174:0:14396:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 83858f7d-0f97-4f68-815c-0077941bf864@192.168.202.36@tcp t0 exp 0000000000000000 cur 559 last 0 00000020:00000080:3.0:1787580211.256222:0:14396:0:(genops.c:1385:class_connect()) connect: client 83858f7d-0f97-4f68-815c-0077941bf864, cookie 0xc86deac208338aff 00000004:00100000:3.0:1787580211.256272:0:14396:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1787580211.256432:0:14396:0:(import.c:65:import_set_state_nolock()) ffff8fad412a4000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787580211.256514:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae50729f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83858f7d-0f97-4f68-815c-0077941bf864+6:2357:x1874413239777152:12345-192.168.202.36@tcp:38:mount.lustre.0 Request processed in 376us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580211.256524:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 10 00000100:00100000:1.0:1787580211.270264:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580211.270790:0:15103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239777408 00000100:00100000:2.0:1787580211.270801:0:15103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239777408 00000100:00100000:2.0:1787580211.270892:0:15103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 11 00000100:00100000:2.0:1787580211.270903:0:15103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5072b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83858f7d-0f97-4f68-815c-0077941bf864+6:13931:x1874413239777408:12345-192.168.202.36@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787580211.270953:0:15103:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787580211.271037:0:15103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5072b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83858f7d-0f97-4f68-815c-0077941bf864+6:13931:x1874413239777408:12345-192.168.202.36@tcp:41:mount.lustre.0 Request processed in 135us (780us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580211.271044:0:15103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 11 00000100:00080000:0.0:1787580211.271354:0:14391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787580211.277657:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580211.277825:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239777280 00000100:00100000:0.0:1787580211.277836:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239777280 00000100:00100000:0.0:1787580211.277901:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 12 00000100:00100000:0.0:1787580211.277913:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5072b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83858f7d-0f97-4f68-815c-0077941bf864+6:0:x1874413239777280:12345-192.168.202.36@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787580211.277945:0:14396:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787580211.278016:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5072b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83858f7d-0f97-4f68-815c-0077941bf864+6:0:x1874413239777280:12345-192.168.202.36@tcp:41:mount.lustre.0 Request processed in 105us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580211.278024:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 12 00000100:00100000:1.0:1787580211.291359:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580211.291446:0:15103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239777536 00000100:00100000:2.0:1787580211.291457:0:15103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239777536 00000100:00100000:2.0:1787580211.291522:0:15103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 13 00000100:00100000:2.0:1787580211.291535:0:15103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae50729c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83858f7d-0f97-4f68-815c-0077941bf864+6:13931:x1874413239777536:12345-192.168.202.36@tcp:40:mount.lustre.0 00000100:00100000:2.0:1787580211.291636:0:15103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae50729c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83858f7d-0f97-4f68-815c-0077941bf864+6:13931:x1874413239777536:12345-192.168.202.36@tcp:40:mount.lustre.0 Request processed in 95us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580211.291659:0:15103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 13 00000100:00100000:1.0:1787580211.298938:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580211.298982:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580211.299116:0:15079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239777664 00000100:00100000:3.0:1787580211.299126:0:15079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239777664 00000100:00100000:3.0:1787580211.299174:0:15079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239777792 00000100:00100000:3.0:1787580211.299177:0:15079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239777792 00000100:00100000:3.0:1787580211.299193:0:15079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 11 00000100:00100000:3.0:1787580211.299202:0:15079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5072ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2357:x1874413239777664:12345-192.168.202.36@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787580211.299234:0:15079:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 83858f7d-0f97-4f68-815c-0077941bf864@192.168.202.36@tcp t0 exp 0000000000000000 cur 559 last 0 00000020:00000080:3.0:1787580211.299497:0:15079:0:(genops.c:1385:class_connect()) connect: client 83858f7d-0f97-4f68-815c-0077941bf864, cookie 0xc86deac208338b06 00002000:00100000:3.0:1787580211.299509:0:15079:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 83858f7d-0f97-4f68-815c-0077941bf864/ffff8fad412a5800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787580211.299521:0:15079:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787580211.300233:0:15079:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787580211.301102:0:15079:0:(import.c:65:import_set_state_nolock()) ffff8fad412a5000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787580211.301257:0:15079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5072ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:83858f7d-0f97-4f68-815c-0077941bf864+6:2357:x1874413239777664:12345-192.168.202.36@tcp:8:mount.lustre.0 Request processed in 2042us (2316us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580211.301268:0:15079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 11 00000100:00100000:3.0:1787580211.301302:0:15079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 12 00000100:00100000:3.0:1787580211.301309:0:15079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51cac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2357:x1874413239777792:12345-192.168.202.36@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787580211.301345:0:15079:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 83858f7d-0f97-4f68-815c-0077941bf864@192.168.202.36@tcp t0 exp 0000000000000000 cur 559 last 0 00000020:00000080:3.0:1787580211.301371:0:15079:0:(genops.c:1385:class_connect()) connect: client 83858f7d-0f97-4f68-815c-0077941bf864, cookie 0xc86deac208338b0d 00002000:00100000:3.0:1787580211.301403:0:15079:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 83858f7d-0f97-4f68-815c-0077941bf864/ffff8fae56dd8800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787580211.301414:0:15079:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787580211.301667:0:15079:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787580211.301686:0:15079:0:(import.c:65:import_set_state_nolock()) ffff8fae4426e800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787580211.301724:0:15079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51cac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:83858f7d-0f97-4f68-815c-0077941bf864+6:2357:x1874413239777792:12345-192.168.202.36@tcp:8:mount.lustre.0 Request processed in 414us (2741us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580211.301853:0:15079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 12 00000100:00100000:1.0:1787580211.303457:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580211.303615:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239777920 00000100:00100000:0.0:1787580211.303626:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239777920 00000100:00100000:0.0:1787580211.303690:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 1 00000100:00100000:0.0:1787580211.303699:0:14399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51caf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:83858f7d-0f97-4f68-815c-0077941bf864+6:13931:x1874413239777920:12345-192.168.202.36@tcp:33:mount.lustre.0 00000004:00200000:0.0:1787580211.303963:0:14399:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:0.0:1787580211.304112:0:14399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51caf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:83858f7d-0f97-4f68-815c-0077941bf864+6:13931:x1874413239777920:12345-192.168.202.36@tcp:33:mount.lustre.0 Request processed in 413us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580211.304121:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 1 00010000:00010000:2.0:1787580211.443973:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787580211.463772:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580211.464182:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239778048 00000100:00100000:0.0:1787580211.464194:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239778048 00000100:00100000:0.0:1787580211.464263:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 14 00000100:00100000:0.0:1787580211.464287:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d5bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83858f7d-0f97-4f68-815c-0077941bf864+6:13964:x1874413239778048:12345-192.168.202.36@tcp:101:mkdir.0 00010000:00010000:0.0:1787580211.464307:0:14396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787580211.464330:0:14396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea200/0xc86deac208338b14 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d536 expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580211.464436:0:14396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea400/0xc86deac208338b1b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580211.464450:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea400/0xc86deac208338b1b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580211.464463:0:14396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea400/0xc86deac208338b1b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787580211.464996:0:14396:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787580211.465002:0:14396:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1787580211.465087:0:14396:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea400/0xc86deac208338b1b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580211.465117:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea200/0xc86deac208338b14 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d536 expref: 8 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580211.465136:0:14396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea400/0xc86deac208338b1b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d536 expref: 7 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580211.465145:0:14396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fae4537f300) 00010000:00010000:0.0:1787580211.465147:0:14396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787580211.465151:0:14396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae50fea400, rc 0) 00000100:00100000:0.0:1787580211.465287:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d5bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83858f7d-0f97-4f68-815c-0077941bf864+7:13964:x1874413239778048:12345-192.168.202.36@tcp:101:mkdir.0 Request processed in 1001us (1523us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580211.465304:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 14 00010000:00010000:1.0:1787580212.467774:0:15522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787580213.368588:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae507ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874413262838528:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787580213.368675:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580213.372766:0:15083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262838528 00000100:00100000:3.0:1787580213.372781:0:15083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262838528 00000100:00100000:3.0:1787580213.372858:0:15083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787580213.372870:0:15083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7ec35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874413262838528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787580213.372914:0:15083:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787580213.373017:0:15083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7ec35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874413262838528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 149us (4341us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580213.373025:0:15083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1787580213.373674:0:14391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787580213.374765:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae507ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874413262838528:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787580213.491598:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787580213.493603:0:5874:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 1a27ab63-1899-406a-bdda-fd6b0377149d 00000001:00100000:2.0:1787580213.493620:0:5874:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 83858f7d-0f97-4f68-815c-0077941bf864 00000001:00100000:2.0:1787580213.496515:0:6733:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 83858f7d-0f97-4f68-815c-0077941bf864 00000100:00100000:0.0:1787580213.875682:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae51cad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262838656:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787580213.875778:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787580213.875858:0:15083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262838656 00000100:00100000:1.0:1787580213.875868:0:15083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262838656 00000100:00100000:1.0:1787580213.875950:0:15083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787580213.875962:0:15083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7ec36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262838656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787580213.876004:0:15083:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787580213.876068:0:15083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7ec36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262838656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580213.876076:0:15083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787580213.876116:0:3316:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1787580213.876137:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae51cad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262838656:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1787580213.877732:0:14391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787580213.878763:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d5b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874413262838912:0@lo:400:kworker.0 00000100:00100000:3.0:1787580213.878840:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580213.878891:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787580213.878897:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d5bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874413262839040:0@lo:400:kworker.0 00000100:00100000:3.0:1787580213.878932:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580213.878968:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262838912 00000100:00100000:3.0:1787580213.878975:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262838912 00000100:00100000:3.0:1787580213.879018:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262839040 00000100:00100000:3.0:1787580213.879021:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262839040 00000100:00100000:3.0:1787580213.879050:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787580213.879060:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae507ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874413262838912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787580213.879118:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae507ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874413262838912:12345-0@lo:400:kworker.0 Request processed in 59us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580213.879142:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787580213.879158:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787580213.879165:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae507b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874413262839040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787580213.879198:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae507b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874413262839040:12345-0@lo:400:kworker.0 Request processed in 34us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580213.879203:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787580213.879221:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d5bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5949e638-96f6-489a-aea1-b9b80ed3224f:3317:1874413262838784:0@lo:400:kworker.0 00000100:00100000:3.0:1787580213.879254:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580213.879281:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787580213.879287:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d5b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1874413262839168:0@lo:400:kworker.0 00000100:00100000:3.0:1787580213.879306:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580213.879348:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d5bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874413262839040:0@lo:400:kworker.0 00000100:00100000:3.0:1787580213.879358:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d5b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874413262838912:0@lo:400:kworker.0 00000100:00100000:3.0:1787580213.879378:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262839168 00000100:00100000:3.0:1787580213.879407:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262839168 00000100:00100000:3.0:1787580213.879428:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787580213.879434:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae507baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1874413262839168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787580213.879470:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae507baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1874413262839168:12345-0@lo:400:kworker.0 Request processed in 36us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580213.879476:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787580213.879500:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d5b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1874413262839168:0@lo:400:kworker.0 00000100:00100000:0.0:1787580213.879602:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262838784 00000100:00100000:0.0:1787580213.879606:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262838784 00000100:00100000:0.0:1787580213.879644:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787580213.879651:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74f09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5949e638-96f6-489a-aea1-b9b80ed3224f+19:3317:x1874413262838784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787580213.879697:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74f09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5949e638-96f6-489a-aea1-b9b80ed3224f+19:3317:x1874413262838784:12345-0@lo:400:kworker.0 Request processed in 47us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580213.879703:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:0.0:1787580213.879729:0:14391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787580213.882451:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d5bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5949e638-96f6-489a-aea1-b9b80ed3224f:3317:1874413262838784:0@lo:400:kworker.0 00000001:00100000:3.0:1787580213.970007:0:7653:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 83858f7d-0f97-4f68-815c-0077941bf864 00010000:00010000:2.0:1787580214.515935:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787580215.057702:0:16366:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1787580215.541477:0:15522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787580216.565472:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787580216.780316:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580216.780372:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580216.780427:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580216.780428:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239778304 00000100:00100000:0.0:1787580216.780438:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239778304 00000100:00100000:3.0:1787580216.780453:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580216.780470:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580216.780502:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 20 00000100:00100000:3.0:1787580216.780503:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580216.780513:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae507bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a27ab63-1899-406a-bdda-fd6b0377149d+6:2358:x1874413239778304:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:3.0:1787580216.780526:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580216.780543:0:15079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239778560 00000100:00100000:3.0:1787580216.780546:0:15079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239778560 00000100:00100000:3.0:1787580216.780568:0:15079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239778816 00000100:00100000:3.0:1787580216.780570:0:15079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239778816 00000100:00100000:0.0:1787580216.780589:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae507bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a27ab63-1899-406a-bdda-fd6b0377149d+6:2358:x1874413239778304:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 78us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580216.780596:0:15079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239778432 00000100:00100000:3.0:1787580216.780598:0:15079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239778432 00000100:00100000:0.0:1787580216.780598:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 20 00000100:00100000:3.0:1787580216.780609:0:15079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239778944 00000100:00100000:3.0:1787580216.780611:0:15079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239778944 00000100:00100000:0.0:1787580216.780611:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239778688 00000100:00100000:0.0:1787580216.780614:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239778688 00000100:00100000:3.0:1787580216.780624:0:15079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 4 00000100:00100000:3.0:1787580216.780631:0:15079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae507b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1a27ab63-1899-406a-bdda-fd6b0377149d+5:2358:x1874413239778560:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:0.0:1787580216.780632:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 21 00000100:00100000:0.0:1787580216.780637:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83858f7d-0f97-4f68-815c-0077941bf864+6:2358:x1874413239778688:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:3.0:1787580216.780672:0:15079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae507b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1a27ab63-1899-406a-bdda-fd6b0377149d+5:2358:x1874413239778560:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 41us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580216.780679:0:15079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 4 00000100:00100000:0.0:1787580216.780684:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83858f7d-0f97-4f68-815c-0077941bf864+6:2358:x1874413239778688:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 46us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580216.780691:0:15079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 5 00000100:00100000:0.0:1787580216.780691:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 21 00000100:00100000:3.0:1787580216.780697:0:15079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae507b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:83858f7d-0f97-4f68-815c-0077941bf864+5:2358:x1874413239778816:12345-192.168.202.36@tcp:400:kworker.0 00000100:00080000:0.0:1787580216.780706:0:14391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787580216.780711:0:14391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787580216.780713:0:14391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787580216.780721:0:15079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae507b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:83858f7d-0f97-4f68-815c-0077941bf864+5:2358:x1874413239778816:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 24us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580216.780727:0:15079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 5 00000100:00100000:3.0:1787580216.780738:0:15079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 6 00000100:00100000:3.0:1787580216.780743:0:15079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae507bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1a27ab63-1899-406a-bdda-fd6b0377149d+5:2358:x1874413239778432:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:3.0:1787580216.780772:0:15079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae507bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1a27ab63-1899-406a-bdda-fd6b0377149d+5:2358:x1874413239778432:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 28us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580216.780779:0:15079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 6 00000100:00100000:3.0:1787580216.780791:0:15079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 7 00000100:00100000:3.0:1787580216.780796:0:15079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:83858f7d-0f97-4f68-815c-0077941bf864+5:2358:x1874413239778944:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:3.0:1787580216.780816:0:15079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:83858f7d-0f97-4f68-815c-0077941bf864+5:2358:x1874413239778944:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 20us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580216.780822:0:15079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 7 00000100:00100000:3.0:1787580216.780839:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239778176 00000100:00100000:3.0:1787580216.780842:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239778176 00000100:00100000:3.0:1787580216.780867:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 104 00000100:00100000:3.0:1787580216.780874:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74f09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3458fe6f-27ac-41dd-98c0-57097478e8b1+13:2358:x1874413239778176:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:3.0:1787580216.780913:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74f09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3458fe6f-27ac-41dd-98c0-57097478e8b1+13:2358:x1874413239778176:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 38us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580216.780920:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 104 00010000:00010000:2.0:1787580217.587788:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787580218.037783:0:14427:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787580218.483987:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae779ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874413262839296:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787580218.484057:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787580218.484313:0:15083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262839296 00000100:00100000:1.0:1787580218.484322:0:15083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262839296 00000100:00100000:1.0:1787580218.484443:0:15083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787580218.484454:0:15083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874413262839296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787580218.484858:0:15083:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787580218.484915:0:15083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874413262839296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 463us (858us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580218.484924:0:15083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787580218.485000:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae779ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874413262839296:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787580218.485506:0:14391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787580218.611533:0:15522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787580218.895366:0:16513:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffac656310 20000000:00000080:3.0:1787580218.895752:0:16513:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8fae66898000 uarg=0000000000000000 20000000:01000000:3.0:1787580218.895789:0:16513:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787580218.895795:0:16513:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787580218.895800:0:16513:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1787580218.898217:0:16514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:3.0:1787580218.899072:0:16513:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1787580218.906281:0:16513:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787580218.906334:0:16513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8fae4150e400/0xc86deac208338b22 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580218.906356:0:16513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fae48db8200/0xc86deac208338819 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac208338812 expref: 18 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580218.906364:0:16513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fae48db9000/0xc86deac208338866 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac20833885f expref: 18 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580218.906372:0:16513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fae4ca58a00/0xc86deac2083389a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac20833899a expref: 18 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580218.906766:0:16513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fae50feb800/0xc86deac208338ac0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d4aa expref: 12 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580218.906776:0:16513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8fae4150fa00/0xc86deac208338af8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d50c expref: 12 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580218.906783:0:16513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8fae4150e400/0xc86deac208338b22 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580218.906832:0:16513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fae4150fa00/0xc86deac208338af8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d50c expref: 12 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580218.906846:0:16513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8fae4150fa00/0xc86deac208338af8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d50c expref: 12 pid: 14389 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580218.906861:0:16513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae779bbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16513:1874413262839424:192.168.202.36@tcp:104: 00010000:00010000:3.0:1787580218.906970:0:16513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fae50feb800/0xc86deac208338ac0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d4aa expref: 12 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580218.906992:0:16513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8fae50feb800/0xc86deac208338ac0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d4aa expref: 12 pid: 14388 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580218.907001:0:16513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae779b9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16513:1874413262839552:192.168.202.36@tcp:104: 00010000:00010000:3.0:1787580218.907034:0:16513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fae4ca58a00/0xc86deac2083389a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc86deac20833899a expref: 18 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580218.907041:0:16513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8fae4ca58a00/0xc86deac2083389a1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc86deac20833899a expref: 18 pid: 14388 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580218.907050:0:16513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae779b8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16513:1874413262839680:0@lo:104: 00000100:00100000:3.0:1787580218.907087:0:16513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787580218.907131:0:16513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fae48db9000/0xc86deac208338866 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc86deac20833885f expref: 18 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580218.907139:0:16513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8fae48db9000/0xc86deac208338866 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc86deac20833885f expref: 18 pid: 14389 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580218.907147:0:16513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae779bb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16513:1874413262839808:0@lo:104: 00000100:00100000:3.0:1787580218.907165:0:16513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787580218.907183:0:16513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8fae48db8200/0xc86deac208338819 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc86deac208338812 expref: 18 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580218.907190:0:16513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8fae48db8200/0xc86deac208338819 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc86deac208338812 expref: 18 pid: 14388 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580218.907198:0:16513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae779bb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16513:1874413262839936:0@lo:104: 00000100:00100000:3.0:1787580218.907218:0:16513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580218.907236:0:16513:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae5061b180 going to sleep for 11 seconds 00000100:00100000:2.0:1787580218.907320:0:14378:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787580218.907340:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262839680 00000100:00100000:2.0:1787580218.907348:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262839680 00000100:00100000:2.0:1787580218.907418:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262839808 00000100:00100000:2.0:1787580218.907423:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262839808 00000100:00100000:2.0:1787580218.907436:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262839936 00000100:00100000:2.0:1787580218.907439:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262839936 00000100:00100000:2.0:1787580218.907452:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787580218.907472:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5949e638-96f6-489a-aea1-b9b80ed3224f+5:16513:x1874413262839680:12345-0@lo:104: 00010000:00010000:2.0:1787580218.907486:0:14378:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.136@tcp lock: ffff8fae6dfb6800/0xc86deac20833899a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc86deac2083389a1 expref: -99 pid: 15799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580218.907554:0:14378:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787580218.907629:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5949e638-96f6-489a-aea1-b9b80ed3224f+5:16513:x1874413262839680:12345-0@lo:104: Request processed in 168us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580218.907649:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787580218.907669:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787580218.907676:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5949e638-96f6-489a-aea1-b9b80ed3224f+4:16513:x1874413262839808:12345-0@lo:104: 00010000:00010000:2.0:1787580218.907684:0:14378:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.136@tcp lock: ffff8fae5f6d6200/0xc86deac20833885f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc86deac208338866 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580218.907721:0:14378:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787580218.907726:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5949e638-96f6-489a-aea1-b9b80ed3224f+4:16513:x1874413262839808:12345-0@lo:104: Request processed in 52us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580218.907732:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787580218.907746:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787580218.907752:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7efd4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5949e638-96f6-489a-aea1-b9b80ed3224f+3:16513:x1874413262839936:12345-0@lo:104: 00010000:00010000:2.0:1787580218.907759:0:14378:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.136@tcp lock: ffff8fae4ca59800/0xc86deac208338812 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc86deac208338819 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580218.907791:0:14378:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787580218.907796:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7efd4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5949e638-96f6-489a-aea1-b9b80ed3224f+3:16513:x1874413262839936:12345-0@lo:104: Request processed in 46us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580218.907802:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1787580218.907845:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787580218.907852:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.136@tcp lock: ffff8fae6dfb6800/0xc86deac20833899a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc86deac2083389a1 expref: -99 pid: 15799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580218.907859:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae6dfb6800 already unused, calling callback (ffffffffc1b77c20) 10000000:00010000:2.0:1787580218.907863:0:14384:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.136@tcp lock: ffff8fae6dfb6800/0xc86deac20833899a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc86deac2083389a1 expref: -99 pid: 15799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580218.907872:0:14384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: ffff8fae6dfb6800/0xc86deac20833899a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc86deac2083389a1 expref: -99 pid: 15799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787580218.907880:0:14384:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: ffff8fae6dfb6800/0xc86deac20833899a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc86deac2083389a1 expref: -99 pid: 15799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787580218.907887:0:14384:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787580218.907927:0:14384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.136@tcp lock: ffff8fae6dfb6800/0xc86deac20833899a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac2083389a1 expref: -99 pid: 15799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580218.907934:0:14384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787580218.907954:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.136@tcp lock: ffff8fae6dfb6800/0xc86deac20833899a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac2083389a1 expref: -99 pid: 15799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580218.907960:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: ffff8fae6dfb6800/0xc86deac20833899a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac2083389a1 expref: -99 pid: 15799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580218.907973:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787580218.907976:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.136@tcp lock: ffff8fae5f6d6200/0xc86deac20833885f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc86deac208338866 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580218.907982:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae5f6d6200 already unused, calling callback (ffffffffc1b77c20) 10000000:00010000:2.0:1787580218.907985:0:14384:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.136@tcp lock: ffff8fae5f6d6200/0xc86deac20833885f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc86deac208338866 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580218.907992:0:14384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: ffff8fae5f6d6200/0xc86deac20833885f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc86deac208338866 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787580218.907998:0:14384:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: ffff8fae5f6d6200/0xc86deac20833885f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc86deac208338866 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787580218.908003:0:14384:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787580218.908015:0:14384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.136@tcp lock: ffff8fae5f6d6200/0xc86deac20833885f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac208338866 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580218.908021:0:14384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787580218.908026:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.136@tcp lock: ffff8fae5f6d6200/0xc86deac20833885f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac208338866 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580218.908043:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: ffff8fae5f6d6200/0xc86deac20833885f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac208338866 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580218.908051:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787580218.908054:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.136@tcp lock: ffff8fae4ca59800/0xc86deac208338812 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc86deac208338819 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580218.908060:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae4ca59800 already unused, calling callback (ffffffffc1b77c20) 10000000:00010000:2.0:1787580218.908063:0:14384:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.136@tcp lock: ffff8fae4ca59800/0xc86deac208338812 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc86deac208338819 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580218.908070:0:14384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.136@tcp lock: ffff8fae4ca59800/0xc86deac208338812 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc86deac208338819 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787580218.908076:0:14384:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.136@tcp lock: ffff8fae4ca59800/0xc86deac208338812 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc86deac208338819 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787580218.908081:0:14384:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787580218.908093:0:14384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.136@tcp lock: ffff8fae4ca59800/0xc86deac208338812 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac208338819 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580218.908099:0:14384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787580218.908116:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.136@tcp lock: ffff8fae4ca59800/0xc86deac208338812 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac208338819 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580218.908123:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.136@tcp lock: ffff8fae4ca59800/0xc86deac208338812 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc86deac208338819 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580218.908135:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787580218.908141:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787580218.908142:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787580218.908149:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787580218.908155:0:15522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787580218.908172:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d5ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5949e638-96f6-489a-aea1-b9b80ed3224f:3314:1874413262840064:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787580218.908203:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787580218.908227:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787580218.908233:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d5bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5949e638-96f6-489a-aea1-b9b80ed3224f:3314:1874413262840192:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787580218.908252:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787580218.908280:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d5b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5949e638-96f6-489a-aea1-b9b80ed3224f:3316:1874413262840320:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787580218.908302:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787580218.908335:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262840064 00000100:00100000:2.0:1787580218.908340:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262840064 00010000:00010000:2.0:1787580218.908358:0:14380:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fae4ca58a00/0xc86deac2083389a1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc86deac20833899a expref: 19 pid: 14388 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580218.908372:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262840192 00000100:00100000:2.0:1787580218.908375:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262840192 00010000:00010000:2.0:1787580218.908408:0:14380:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fae48db9000/0xc86deac208338866 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc86deac20833885f expref: 20 pid: 14389 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580218.908418:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262840320 00000100:00100000:2.0:1787580218.908420:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262840320 00010000:00010000:2.0:1787580218.908429:0:14380:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fae48db8200/0xc86deac208338819 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc86deac208338812 expref: 21 pid: 14388 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580218.908441:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787580218.908447:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d5b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5949e638-96f6-489a-aea1-b9b80ed3224f+21:3314:x1874413262840064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787580218.908458:0:14380:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787580218.908470:0:14380:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fae4ca58a00/0xc86deac2083389a1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc86deac20833899a expref: 21 pid: 14388 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580218.908480:0:14380:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fae4ca58a00/0xc86deac2083389a1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc86deac20833899a expref: 21 pid: 14388 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580218.908497:0:14380:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787580218.908527:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d5b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5949e638-96f6-489a-aea1-b9b80ed3224f+21:3314:x1874413262840064:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580218.908534:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787580218.908548:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787580218.908554:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d5bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5949e638-96f6-489a-aea1-b9b80ed3224f+20:3314:x1874413262840192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787580218.908726:0:16513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fae4ca58a00/0xc86deac2083389a1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc86deac20833899a expref: 20 pid: 14388 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580218.908739:0:16513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae779b8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16513:1874413262839680:0@lo:104: 00000100:00100000:3.0:1787580218.908749:0:16513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae779bb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16513:1874413262839808:0@lo:104: 00000100:00100000:3.0:1787580218.908756:0:16513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae779bb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16513:1874413262839936:0@lo:104: 00000100:00100000:3.0:1787580218.910813:0:14381:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1787580218.910835:0:14381:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1787580218.910856:0:14382:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1787580218.910869:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787580218.910882:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48e46050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5949e638-96f6-489a-aea1-b9b80ed3224f+19:3316:x1874413262840320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787580218.910901:0:14382:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787580218.910909:0:14382:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fae48db8200/0xc86deac208338819 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc86deac208338812 expref: 19 pid: 14388 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580218.910923:0:14382:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fae48db8200/0xc86deac208338819 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc86deac208338812 expref: 19 pid: 14388 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580218.910940:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fae48db8200/0xc86deac208338819 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc86deac208338812 expref: 19 pid: 14388 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580218.910953:0:14382:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787580218.911024:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48e46050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5949e638-96f6-489a-aea1-b9b80ed3224f+18:3316:x1874413262840320:12345-0@lo:103:ldlm_bl.0 Request processed in 146us (2720us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580218.911032:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1787580218.913792:0:14380:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787580218.913810:0:14380:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fae48db9000/0xc86deac208338866 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc86deac20833885f expref: 17 pid: 14389 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580218.913826:0:14380:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fae48db9000/0xc86deac208338866 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc86deac20833885f expref: 17 pid: 14389 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580218.913845:0:14380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fae48db9000/0xc86deac208338866 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc86deac20833885f expref: 17 pid: 14389 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580218.914454:0:14380:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787580218.915067:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580218.915121:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580218.915177:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d5bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5949e638-96f6-489a-aea1-b9b80ed3224f+16:3314:x1874413262840192:12345-0@lo:103:ldlm_bl.0 Request processed in 6621us (6921us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580218.915188:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787580218.915264:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239779072 00000100:00100000:2.0:1787580218.915273:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239779072 00010000:00010000:2.0:1787580218.915303:0:14380:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fae4150fa00/0xc86deac208338af8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d50c expref: 13 pid: 14389 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580218.915352:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239779200 00000100:00100000:2.0:1787580218.915355:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239779200 00010000:00010000:2.0:1787580218.915370:0:14380:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8fae50feb800/0xc86deac208338ac0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d4aa expref: 14 pid: 14388 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580218.915414:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 7 00000100:00100000:2.0:1787580218.915423:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51cad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3458fe6f-27ac-41dd-98c0-57097478e8b1+14:2361:x1874413239779072:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787580218.915435:0:14380:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787580218.915440:0:14380:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fae4150fa00/0xc86deac208338af8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d50c expref: 14 pid: 14389 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580218.915450:0:14380:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fae4150fa00/0xc86deac208338af8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d50c expref: 14 pid: 14389 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580218.915477:0:14380:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787580218.915518:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51cad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3458fe6f-27ac-41dd-98c0-57097478e8b1+14:2361:x1874413239779072:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 96us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580218.915525:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 7 00000100:00100000:2.0:1787580218.915537:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 8 00000100:00100000:2.0:1787580218.915556:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51cafb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3458fe6f-27ac-41dd-98c0-57097478e8b1+13:2361:x1874413239779200:12345-192.168.202.36@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787580218.915688:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d5bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5949e638-96f6-489a-aea1-b9b80ed3224f:3314:1874413262840192:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787580218.915700:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d5ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5949e638-96f6-489a-aea1-b9b80ed3224f:3314:1874413262840064:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787580218.915773:0:16513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fae4150fa00/0xc86deac208338af8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d50c expref: 13 pid: 14389 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580218.915786:0:16513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae779bbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16513:1874413262839424:192.168.202.36@tcp:104: 00000100:00100000:3.0:1787580218.915795:0:16513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae779b9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16513:1874413262839552:192.168.202.36@tcp:104: 00010000:00010000:3.0:1787580218.915823:0:16513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8fae4150e400/0xc86deac208338b22 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580218.916721:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d5b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5949e638-96f6-489a-aea1-b9b80ed3224f:3316:1874413262840320:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787580218.917865:0:14380:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787580218.917876:0:14380:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8fae50feb800/0xc86deac208338ac0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d4aa expref: 12 pid: 14388 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580218.917891:0:14380:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8fae50feb800/0xc86deac208338ac0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d4aa expref: 12 pid: 14388 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580218.917927:0:14380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fae50feb800/0xc86deac208338ac0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d4aa expref: 12 pid: 14388 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580218.917943:0:14380:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8fae4150e400/0xc86deac208338b22 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580218.917951:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fae4150e400/0xc86deac208338b22 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580218.917969:0:14380:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fae4150e400/0xc86deac208338b22 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580218.917976:0:14380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8fae4150e400/0xc86deac208338b22 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580218.917983:0:14380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8fae4150e400/0xc86deac208338b22 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580218.917990:0:14380:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8fae4150e400/0xc86deac208338b22 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580218.917996:0:14380:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae4150e400 already unused, calling callback (ffffffffc155a230) 00010000:00010000:2.0:1787580218.918001:0:14380:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8fae4150e400/0xc86deac208338b22 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580218.918009:0:14380:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8fae4150e400/0xc86deac208338b22 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580218.923118:0:16513:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8fae4150e400/0xc86deac208338b22 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580218.923139:0:16513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8fae4150e400/0xc86deac208338b22 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580218.925996:0:14380:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8fae4150e400/0xc86deac208338b22 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580218.926026:0:14380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8fae4150e400/0xc86deac208338b22 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580218.926048:0:14380:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787580218.926132:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51cafb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3458fe6f-27ac-41dd-98c0-57097478e8b1+11:2361:x1874413239779200:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 10573us (11006us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580218.926142:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 8 00000100:00100000:3.0:1787580219.001797:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d5bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874413262840576:0@lo:400:kworker.0 00000100:00100000:3.0:1787580219.001870:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580219.001912:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787580219.001918:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d5b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874413262840704:0@lo:400:kworker.0 00000100:00100000:3.0:1787580219.001941:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787580219.001992:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d5b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874413262840448:0@lo:400:kworker.0 00000100:00100000:2.0:1787580219.002032:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787580219.002061:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787580219.002067:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d5ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1874413262840832:0@lo:400:kworker.0 00000100:00100000:2.0:1787580219.002092:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787580219.002131:0:15079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262840448 00000100:00100000:2.0:1787580219.002139:0:15079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262840448 00000100:00100000:2.0:1787580219.002201:0:15079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787580219.002213:0:15079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d5bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1874413262840448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787580219.002271:0:15079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d5bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1874413262840448:12345-0@lo:400:kworker.0 Request processed in 60us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580219.002277:0:15079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1787580219.002298:0:14391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787580219.002334:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d5b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874413262840448:0@lo:400:kworker.0 00000100:00100000:0.0:1787580219.006477:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262840576 00000100:00100000:0.0:1787580219.006496:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262840576 00000100:00100000:0.0:1787580219.006551:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262840704 00000100:00100000:0.0:1787580219.006555:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262840704 00000100:00100000:0.0:1787580219.006575:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262840832 00000100:00100000:0.0:1787580219.006578:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262840832 00000100:00100000:0.0:1787580219.006597:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787580219.006607:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874413262840576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787580219.007030:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874413262840576:12345-0@lo:400:kworker.0 Request processed in 424us (5159us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580219.007040:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787580219.007059:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787580219.007066:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874413262840704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787580219.007110:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874413262840704:12345-0@lo:400:kworker.0 Request processed in 45us (5168us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580219.007117:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787580219.007132:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787580219.007140:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae50728e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1874413262840832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787580219.007176:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae50728e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1874413262840832:12345-0@lo:400:kworker.0 Request processed in 38us (5083us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580219.007183:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787580219.007275:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d5b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874413262840704:0@lo:400:kworker.0 00000100:00100000:0.0:1787580219.007294:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d5bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874413262840576:0@lo:400:kworker.0 00000100:00080000:2.0:1787580219.008107:0:14391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787580219.008143:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d5ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1874413262840832:0@lo:400:kworker.0 00000100:00100000:0.0:1787580219.034725:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787580219.034979:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7ec36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262840960:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787580219.035056:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787580219.035159:0:15083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262840960 00000100:00100000:1.0:1787580219.035169:0:15083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262840960 00000100:00100000:1.0:1787580219.035237:0:15083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787580219.035248:0:15083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7ec34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262840960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787580219.035331:0:15083:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787580219.035445:0:15083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7ec34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262840960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 199us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580219.035454:0:15083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787580219.035595:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7ec36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262840960:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787580219.638426:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787580219.975816:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580219.975900:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239779328 00000100:00100000:3.0:1787580219.975911:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239779328 00000100:00100000:3.0:1787580219.976023:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 105 00000100:00100000:3.0:1787580219.976036:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74f09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3458fe6f-27ac-41dd-98c0-57097478e8b1+11:13816:x1874413239779328:12345-192.168.202.36@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787580219.976052:0:14388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787580219.976071:0:14388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fae4150fa00/0xc86deac208338b29 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d53d expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580219.976099:0:14388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fae4150fa00/0xc86deac208338b29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d53d expref: 12 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580219.976111:0:14388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fae4150fa00/0xc86deac208338b29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d53d expref: 12 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580219.976136:0:14388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae4150fa00, rc 0) 00000100:00100000:3.0:1787580219.976208:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74f09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3458fe6f-27ac-41dd-98c0-57097478e8b1+12:13816:x1874413239779328:12345-192.168.202.36@tcp:101:ll_cfg_requeue.0 Request processed in 175us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580219.976223:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 105 00000100:00100000:3.0:1787580219.981265:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580219.981343:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239779456 00000100:00100000:0.0:1787580219.981356:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239779456 00000100:00100000:0.0:1787580219.981432:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 106 00000100:00100000:0.0:1787580219.981442:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74f08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3458fe6f-27ac-41dd-98c0-57097478e8b1+12:13816:x1874413239779456:12345-192.168.202.36@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787580219.981898:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74f08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3458fe6f-27ac-41dd-98c0-57097478e8b1+12:13816:x1874413239779456:12345-192.168.202.36@tcp:501:ll_cfg_requeue.0 Request processed in 455us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580219.981907:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 106 00000100:00100000:2.0:1787580219.996280:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580219.996326:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239779584 00000100:00100000:2.0:1787580219.996338:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239779584 00000100:00100000:2.0:1787580219.996414:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 107 00000100:00100000:2.0:1787580219.996426:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74f0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3458fe6f-27ac-41dd-98c0-57097478e8b1+12:13816:x1874413239779584:12345-192.168.202.36@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787580219.996693:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74f0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3458fe6f-27ac-41dd-98c0-57097478e8b1+12:13816:x1874413239779584:12345-192.168.202.36@tcp:503:ll_cfg_requeue.0 Request processed in 268us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580219.996715:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 107 00000100:00100000:1.0:1787580220.021958:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580220.022155:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239779712 00000100:00100000:3.0:1787580220.022165:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239779712 00000100:00100000:3.0:1787580220.022266:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 108 00000100:00100000:3.0:1787580220.022277:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74f0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3458fe6f-27ac-41dd-98c0-57097478e8b1+12:13816:x1874413239779712:12345-192.168.202.36@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787580220.022296:0:14390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787580220.022315:0:14390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fae4150f000/0xc86deac208338b30 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d544 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580220.022346:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fae4150f000/0xc86deac208338b30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d544 expref: 13 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580220.022356:0:14390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fae4150f000/0xc86deac208338b30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d544 expref: 13 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580220.022366:0:14390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae4150f000, rc 0) 00000100:00100000:3.0:1787580220.022498:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74f0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3458fe6f-27ac-41dd-98c0-57097478e8b1+13:13816:x1874413239779712:12345-192.168.202.36@tcp:101:ll_cfg_requeue.0 Request processed in 222us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580220.022505:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 108 00000100:00100000:3.0:1787580220.036879:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580220.038233:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239779840 00000100:00100000:1.0:1787580220.038249:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239779840 00000100:00100000:1.0:1787580220.038309:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 109 00000100:00100000:1.0:1787580220.038320:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74f0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3458fe6f-27ac-41dd-98c0-57097478e8b1+13:13816:x1874413239779840:12345-192.168.202.36@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787580220.038838:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74f0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3458fe6f-27ac-41dd-98c0-57097478e8b1+13:13816:x1874413239779840:12345-192.168.202.36@tcp:501:ll_cfg_requeue.0 Request processed in 518us (1968us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580220.038858:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 109 00000100:00100000:1.0:1787580220.055814:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580220.058468:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239779968 00000100:00100000:3.0:1787580220.058485:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239779968 00000100:00100000:3.0:1787580220.058563:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 110 00000100:00100000:3.0:1787580220.058575:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74f09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3458fe6f-27ac-41dd-98c0-57097478e8b1+13:13816:x1874413239779968:12345-192.168.202.36@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787580220.058837:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74f09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3458fe6f-27ac-41dd-98c0-57097478e8b1+13:13816:x1874413239779968:12345-192.168.202.36@tcp:503:ll_cfg_requeue.0 Request processed in 262us (3034us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580220.058848:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 110 10000000:01000000:2.0:1787580220.660004:0:14393:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787580220.660013:0:14393:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8fae746bf000 from 10 10000000:01000000:2.0:1787580220.660019:0:14393:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787580220.660072:0:14393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae6dfb7c00/0xc86deac208338b37 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580220.660085:0:14393:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff8fae6dfb7c00/0xc86deac208338b37 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580220.660097:0:14393:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff8fae6dfb7c00/0xc86deac208338b37 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580220.660124:0:14393:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d5ba680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5949e638-96f6-489a-aea1-b9b80ed3224f:14393:1874413262841088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787580220.660220:0:14393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787580220.660273:0:14393:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae50e54d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787580220.660296:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262841088 00000100:00100000:2.0:1787580220.660304:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262841088 00000100:00100000:2.0:1787580220.660350:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787580220.660357:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae42b3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5949e638-96f6-489a-aea1-b9b80ed3224f+16:14393:x1874413262841088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787580220.660371:0:14389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787580220.660412:0:14389:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fae6dfb6e00/0xc86deac208338b3e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc86deac208338b37 expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580220.660435:0:14389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fae6dfb6e00/0xc86deac208338b3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc86deac208338b37 expref: 17 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580220.660458:0:14389:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fae6dfb6e00/0xc86deac208338b3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac208338b37 expref: 17 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580220.660468:0:14389:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae6dfb6e00, rc 0) 00000100:00100000:2.0:1787580220.660503:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae42b3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5949e638-96f6-489a-aea1-b9b80ed3224f+17:14393:x1874413262841088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580220.660509:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787580220.662397:0:14393:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d5ba680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5949e638-96f6-489a-aea1-b9b80ed3224f:14393:1874413262841088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787580220.662424:0:14393:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff8fae6dfb7c00/0xc86deac208338b37 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208338b3e expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580220.662437:0:14393:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff8fae6dfb7c00/0xc86deac208338b37 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc86deac208338b3e expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580220.662517:0:14393:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d5ba680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5949e638-96f6-489a-aea1-b9b80ed3224f:14393:1874413262841216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787580220.663754:0:14393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787580220.663793:0:14393:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae50e54d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787580220.663822:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262841216 00000100:00100000:2.0:1787580220.663828:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262841216 00000100:00100000:2.0:1787580220.663871:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787580220.663879:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae42b3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5949e638-96f6-489a-aea1-b9b80ed3224f+17:14393:x1874413262841216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787580220.664127:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae42b3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5949e638-96f6-489a-aea1-b9b80ed3224f+17:14393:x1874413262841216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 248us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580220.664142:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787580220.664187:0:14393:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d5ba680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5949e638-96f6-489a-aea1-b9b80ed3224f:14393:1874413262841216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787580220.666317:0:14393:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae6d5ba680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5949e638-96f6-489a-aea1-b9b80ed3224f:14393:1874413262841344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787580220.666411:0:14393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787580220.666449:0:14393:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae50e54d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787580220.666476:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262841344 00000100:00100000:2.0:1787580220.666484:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262841344 00010000:00010000:3.0:1787580220.666981:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787580220.666998:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787580220.667010:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae42b3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5949e638-96f6-489a-aea1-b9b80ed3224f+17:14393:x1874413262841344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787580220.667685:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae42b3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5949e638-96f6-489a-aea1-b9b80ed3224f+17:14393:x1874413262841344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 617us (1212us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580220.667695:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787580220.669505:0:14393:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae6d5ba680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5949e638-96f6-489a-aea1-b9b80ed3224f:14393:1874413262841344:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787580220.670430:0:16584:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1787580220.670693:0:14393:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1787580220.670716:0:14393:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787580220.670729:0:14393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae6dfb7c00/0xc86deac208338b37 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208338b3e expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580220.670741:0:14393:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff8fae6dfb7c00/0xc86deac208338b37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208338b3e expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787580220.670751:0:14393:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787580220.670754:0:14393:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8fae51c01000 from 10 10000000:01000000:3.0:1787580220.670757:0:14393:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787580220.670799:0:14393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae4150ec00/0xc86deac208338b45 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580220.670808:0:14393:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff8fae4150ec00/0xc86deac208338b45 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580220.670819:0:14393:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff8fae4150ec00/0xc86deac208338b45 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580220.670841:0:14393:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae779bb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5949e638-96f6-489a-aea1-b9b80ed3224f:14393:1874413262841472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787580220.670917:0:14393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580220.670964:0:14393:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae5061b780 going to sleep for 11 seconds 00000100:00100000:0.0:1787580220.671035:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262841472 00000100:00100000:0.0:1787580220.671043:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262841472 00000100:00100000:0.0:1787580220.671097:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787580220.671107:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae42b3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5949e638-96f6-489a-aea1-b9b80ed3224f+17:14393:x1874413262841472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787580220.671133:0:14389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787580220.671146:0:14389:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fae48db8400/0xc86deac208338b4c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc86deac208338b45 expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580220.671172:0:14389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fae48db8400/0xc86deac208338b4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc86deac208338b45 expref: 18 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580220.671182:0:14389:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fae48db8400/0xc86deac208338b4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac208338b45 expref: 18 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580220.671193:0:14389:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae48db8400, rc 0) 00000100:00100000:0.0:1787580220.671246:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae42b3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5949e638-96f6-489a-aea1-b9b80ed3224f+18:14393:x1874413262841472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580220.671253:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787580220.671520:0:14393:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae779bb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5949e638-96f6-489a-aea1-b9b80ed3224f:14393:1874413262841472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787580220.671640:0:14393:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff8fae4150ec00/0xc86deac208338b45 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208338b4c expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580220.671650:0:14393:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff8fae4150ec00/0xc86deac208338b45 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc86deac208338b4c expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580220.671709:0:14393:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae51caf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5949e638-96f6-489a-aea1-b9b80ed3224f:14393:1874413262841600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787580220.671740:0:14393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787580220.671773:0:14393:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fad43647e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787580220.671814:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262841600 00000100:00100000:0.0:1787580220.671819:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262841600 00000100:00100000:0.0:1787580220.671854:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787580220.671862:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae42b3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5949e638-96f6-489a-aea1-b9b80ed3224f+18:14393:x1874413262841600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787580220.672126:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae42b3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5949e638-96f6-489a-aea1-b9b80ed3224f+18:14393:x1874413262841600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 264us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580220.672134:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787580220.672166:0:14393:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae51caf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5949e638-96f6-489a-aea1-b9b80ed3224f:14393:1874413262841600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787580220.672195:0:14393:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7ec37480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5949e638-96f6-489a-aea1-b9b80ed3224f:14393:1874413262841728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787580220.672235:0:14393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580220.672249:0:14393:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae51e926c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787580220.672260:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262841728 00000100:00100000:0.0:1787580220.672263:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262841728 00000100:00100000:0.0:1787580220.672288:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787580220.672293:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7f765450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5949e638-96f6-489a-aea1-b9b80ed3224f+18:14393:x1874413262841728:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787580220.672690:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7f765450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5949e638-96f6-489a-aea1-b9b80ed3224f+18:14393:x1874413262841728:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 395us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580220.672697:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787580220.672736:0:14393:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7ec37480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5949e638-96f6-489a-aea1-b9b80ed3224f:14393:1874413262841728:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787580220.676196:0:16585:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1787580220.686542:0:14393:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1787580220.686579:0:14393:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787580220.686590:0:14393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae4150ec00/0xc86deac208338b45 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208338b4c expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580220.686604:0:14393:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff8fae4150ec00/0xc86deac208338b45 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208338b4c expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787580220.686637:0:14393:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787580220.686640:0:14393:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8fae50b5d800 from 10 10000000:01000000:1.0:1787580220.686643:0:14393:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787580220.686682:0:14393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae4ca58200/0xc86deac208338b53 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580220.686691:0:14393:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.136@tcp lock: ffff8fae4ca58200/0xc86deac208338b53 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580220.686702:0:14393:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.136@tcp lock: ffff8fae4ca58200/0xc86deac208338b53 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580220.686731:0:14393:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae51cad180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5949e638-96f6-489a-aea1-b9b80ed3224f:14393:1874413262841856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787580220.686804:0:14393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787580220.686856:0:14393:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fad43647c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787580220.686991:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262841856 00000100:00100000:0.0:1787580220.687001:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262841856 00000100:00100000:0.0:1787580220.687061:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787580220.687071:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7f764c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5949e638-96f6-489a-aea1-b9b80ed3224f+18:14393:x1874413262841856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787580220.687085:0:14390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787580220.687100:0:14390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8fae48db9800/0xc86deac208338b5a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc86deac208338b53 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580220.687124:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8fae48db9800/0xc86deac208338b5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc86deac208338b53 expref: 19 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580220.687134:0:14390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8fae48db9800/0xc86deac208338b5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc86deac208338b53 expref: 19 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580220.687143:0:14390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae48db9800, rc 0) 00000100:00100000:0.0:1787580220.687186:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7f764c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5949e638-96f6-489a-aea1-b9b80ed3224f+19:14393:x1874413262841856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580220.687193:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787580220.687347:0:14393:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae51cad180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5949e638-96f6-489a-aea1-b9b80ed3224f:14393:1874413262841856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787580220.687364:0:14393:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.136@tcp lock: ffff8fae4ca58200/0xc86deac208338b53 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208338b5a expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580220.687373:0:14393:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.136@tcp lock: ffff8fae4ca58200/0xc86deac208338b53 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc86deac208338b5a expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580220.687474:0:14393:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae51cad180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5949e638-96f6-489a-aea1-b9b80ed3224f:14393:1874413262841984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787580220.687501:0:14393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787580220.688718:0:14393:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fad43647c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787580220.688844:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262841984 00000100:00100000:0.0:1787580220.688853:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262841984 00000100:00100000:0.0:1787580220.688918:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787580220.688943:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7f765c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5949e638-96f6-489a-aea1-b9b80ed3224f+19:14393:x1874413262841984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787580220.689262:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7f765c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5949e638-96f6-489a-aea1-b9b80ed3224f+19:14393:x1874413262841984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 320us (1759us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580220.689271:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1787580220.689351:0:14393:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae51cad180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5949e638-96f6-489a-aea1-b9b80ed3224f:14393:1874413262841984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787580220.689431:0:14393:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae51cad180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5949e638-96f6-489a-aea1-b9b80ed3224f:14393:1874413262842112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787580220.689481:0:14393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787580220.689508:0:14393:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fad43647c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787580220.690509:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262842112 00000100:00100000:3.0:1787580220.690519:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262842112 00000100:00100000:3.0:1787580220.690571:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787580220.690579:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7f766050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5949e638-96f6-489a-aea1-b9b80ed3224f+19:14393:x1874413262842112:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787580220.690785:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7f766050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5949e638-96f6-489a-aea1-b9b80ed3224f+19:14393:x1874413262842112:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 206us (1303us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580220.690794:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1787580220.690955:0:14393:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae51cad180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5949e638-96f6-489a-aea1-b9b80ed3224f:14393:1874413262842112:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787580220.692156:0:16587:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1787580220.694927:0:14393:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1787580220.694978:0:14393:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787580220.694993:0:14393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.136@tcp lock: ffff8fae4ca58200/0xc86deac208338b53 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208338b5a expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580220.695008:0:14393:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.136@tcp lock: ffff8fae4ca58200/0xc86deac208338b53 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc86deac208338b5a expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580221.686509:0:15522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787580221.894986:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580221.895031:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580221.895065:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580221.895099:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580221.895121:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580221.895143:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580221.895165:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580221.895196:0:15080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239780480 00000100:00100000:0.0:1787580221.895196:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239780224 00000100:00100000:0.0:1787580221.895208:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239780224 00000100:00100000:0.0:1787580221.895270:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239780608 00000100:00100000:0.0:1787580221.895273:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239780608 00000100:00100000:0.0:1787580221.895297:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 25 00000100:00100000:0.0:1787580221.895309:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d5bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a27ab63-1899-406a-bdda-fd6b0377149d+6:2359:x1874413239780224:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:2.0:1787580221.895348:0:15080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239780480 00000100:00100000:2.0:1787580221.895379:0:15080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239780736 00000100:00100000:2.0:1787580221.895416:0:15080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239780736 00000100:00100000:0.0:1787580221.895430:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d5bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a27ab63-1899-406a-bdda-fd6b0377149d+6:2359:x1874413239780224:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 122us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580221.895435:0:15080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239780352 00000100:00100000:2.0:1787580221.895439:0:15080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239780352 00000100:00100000:0.0:1787580221.895440:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 25 00000100:00100000:0.0:1787580221.895464:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 26 00000100:00100000:0.0:1787580221.895474:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae507b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83858f7d-0f97-4f68-815c-0077941bf864+6:2359:x1874413239780608:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:2.0:1787580221.895478:0:15080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239780864 00000100:00100000:2.0:1787580221.895482:0:15080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239780864 00000100:00100000:0.0:1787580221.895503:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae507b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83858f7d-0f97-4f68-815c-0077941bf864+6:2359:x1874413239780608:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 31us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580221.895510:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 26 00000100:00080000:0.0:1787580221.895551:0:14391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787580221.895555:0:14391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787580221.895558:0:14391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787580221.895593:0:15079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 9 00000100:00100000:3.0:1787580221.895604:0:15079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d5b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1a27ab63-1899-406a-bdda-fd6b0377149d+5:2359:x1874413239780480:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:3.0:1787580221.895647:0:15079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d5b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1a27ab63-1899-406a-bdda-fd6b0377149d+5:2359:x1874413239780480:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 46us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580221.895654:0:15079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 9 00000100:00100000:3.0:1787580221.895670:0:15079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 10 00000100:00100000:3.0:1787580221.895677:0:15079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d5b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:83858f7d-0f97-4f68-815c-0077941bf864+5:2359:x1874413239780736:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:3.0:1787580221.895702:0:15079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d5b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:83858f7d-0f97-4f68-815c-0077941bf864+5:2359:x1874413239780736:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 26us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580221.895708:0:15079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 10 00000100:00100000:1.0:1787580221.895846:0:15078:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1787580221.895857:0:15078:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1787580221.896079:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239780096 00000100:00100000:1.0:1787580221.896085:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239780096 00000100:00100000:1.0:1787580221.896122:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 120 00000100:00100000:1.0:1787580221.896131:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7f767050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3458fe6f-27ac-41dd-98c0-57097478e8b1+13:2359:x1874413239780096:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:1.0:1787580221.896172:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7f767050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3458fe6f-27ac-41dd-98c0-57097478e8b1+13:2359:x1874413239780096:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 42us (1071us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580221.896267:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 120 00000100:00100000:2.0:1787580221.900673:0:15080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 11 00000100:00100000:0.0:1787580221.900740:0:15078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 12 00000100:00100000:0.0:1787580221.900762:0:15078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7e97df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:83858f7d-0f97-4f68-815c-0077941bf864+5:2359:x1874413239780864:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:0.0:1787580221.900869:0:15078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7e97df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:83858f7d-0f97-4f68-815c-0077941bf864+5:2359:x1874413239780864:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 119us (5702us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580221.900895:0:15078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 12 00000100:00100000:2.0:1787580221.901033:0:15080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d5ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1a27ab63-1899-406a-bdda-fd6b0377149d+5:2359:x1874413239780352:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:2.0:1787580221.901066:0:15080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d5ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1a27ab63-1899-406a-bdda-fd6b0377149d+5:2359:x1874413239780352:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 380us (5944us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580221.901074:0:15080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 11 00010000:00010000:2.0:1787580222.710375:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787580223.017083:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580223.022653:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239780992 00000100:00100000:0.0:1787580223.022672:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239780992 00000100:00100000:0.0:1787580223.022801:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 15 00000100:00100000:0.0:1787580223.022818:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7e97d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a27ab63-1899-406a-bdda-fd6b0377149d+6:14474:x1874413239780992:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787580223.022844:0:14395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787580223.022867:0:14395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac208338b61 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d54b expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580223.023182:0:14395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208338b68 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580223.023198:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208338b68 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580223.023210:0:14395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208338b68 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580223.023224:0:14395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9600/0xc86deac208338b6f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580223.023242:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9600/0xc86deac208338b6f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580223.023249:0:14395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9600/0xc86deac208338b6f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787580223.025926:0:14391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787580223.027657:0:14395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8e00/0xc86deac208338b76 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580223.027707:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8e00/0xc86deac208338b76 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580223.027722:0:14395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8e00/0xc86deac208338b76 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787580223.027893:0:14395:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1787580223.027898:0:14395:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787580223.029410:0:14395:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8e00/0xc86deac208338b76 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580223.029433:0:14395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208338b68 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580223.029440:0:14395:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208338b68 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580223.029447:0:14395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208338b68 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580223.029453:0:14395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db9000 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:0.0:1787580223.029458:0:14395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208338b68 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580223.029466:0:14395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208338b68 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580223.029854:0:14395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fae4537f300) 00010000:00010000:0.0:1787580223.029860:0:14395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787580223.029867:0:14395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208338b68 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580223.029888:0:14395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208338b68 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580223.029907:0:14395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9600/0xc86deac208338b6f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580223.029914:0:14395:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9600/0xc86deac208338b6f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580223.029920:0:14395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9600/0xc86deac208338b6f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580223.029926:0:14395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db9600 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:0.0:1787580223.029929:0:14395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9600/0xc86deac208338b6f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580223.029935:0:14395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9600/0xc86deac208338b6f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580223.030117:0:14395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8fae56e35200) 00010000:00010000:0.0:1787580223.030120:0:14395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787580223.030124:0:14395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9600/0xc86deac208338b6f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580223.030130:0:14395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9600/0xc86deac208338b6f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580223.030191:0:14395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac208338b61 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d54b expref: 8 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580223.030221:0:14395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8e00/0xc86deac208338b76 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d54b expref: 7 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580223.031356:0:14395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8fae56e35e00) 00010000:00010000:0.0:1787580223.031360:0:14395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787580223.031364:0:14395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae48db8e00, rc 0) 00000100:00100000:0.0:1787580223.031476:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7e97d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a27ab63-1899-406a-bdda-fd6b0377149d+7:14474:x1874413239780992:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 Request processed in 8661us (14403us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580223.031495:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 15 00000100:00100000:2.0:1787580223.041567:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580223.048647:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239781248 00000100:00100000:0.0:1787580223.048669:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239781248 00000100:00100000:0.0:1787580223.052729:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 16 00000100:00100000:0.0:1787580223.052747:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7e97ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a27ab63-1899-406a-bdda-fd6b0377149d+7:14474:x1874413239781248:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787580223.052772:0:14397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787580223.052799:0:14397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac208338b7d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d552 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580223.052894:0:14397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9600/0xc86deac208338b84 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580223.052910:0:14397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9600/0xc86deac208338b84 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580223.052922:0:14397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9600/0xc86deac208338b84 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580223.052951:0:14397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208338b8b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580223.052973:0:14397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208338b8b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580223.052980:0:14397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208338b8b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580223.053588:0:14397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8a00/0xc86deac208338b92 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580223.053597:0:14397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8a00/0xc86deac208338b92 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580223.053616:0:14397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8a00/0xc86deac208338b92 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787580223.053628:0:14397:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1787580223.053914:0:14397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9600/0xc86deac208338b84 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580223.053923:0:14397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9600/0xc86deac208338b84 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580223.053930:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9600/0xc86deac208338b84 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580223.053936:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db9600 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:0.0:1787580223.053941:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9600/0xc86deac208338b84 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580223.053949:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9600/0xc86deac208338b84 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580223.053976:0:14397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8fae56e35e00) 00010000:00010000:0.0:1787580223.053979:0:14397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787580223.053985:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9600/0xc86deac208338b84 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580223.053991:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9600/0xc86deac208338b84 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580223.054007:0:14397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208338b8b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580223.054015:0:14397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208338b8b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580223.054021:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208338b8b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580223.054026:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db9000 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:0.0:1787580223.054029:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208338b8b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580223.054035:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208338b8b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580223.054042:0:14397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8fae56e35200) 00010000:00010000:0.0:1787580223.054044:0:14397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787580223.054048:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208338b8b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580223.054053:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208338b8b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580223.054564:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac208338b7d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d552 expref: 10 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580223.054581:0:14397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8a00/0xc86deac208338b92 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d552 expref: 9 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580223.054589:0:14397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8fae56e35600) 00010000:00010000:0.0:1787580223.054592:0:14397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787580223.054595:0:14397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae48db8a00, rc 0) 00000100:00100000:0.0:1787580223.054687:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7e97ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a27ab63-1899-406a-bdda-fd6b0377149d+9:14474:x1874413239781248:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 Request processed in 1943us (13131us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1787580223.054699:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 16 00000100:00100000:1.0:1787580223.072126:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580223.072437:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239781376 00000100:00100000:0.0:1787580223.072449:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239781376 00000100:00100000:0.0:1787580223.072536:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 17 00000100:00100000:0.0:1787580223.072549:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51cad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a27ab63-1899-406a-bdda-fd6b0377149d+9:14474:x1874413239781376:12345-192.168.202.36@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1787580223.072705:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51cad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a27ab63-1899-406a-bdda-fd6b0377149d+9:14474:x1874413239781376:12345-192.168.202.36@tcp:59:lhsmtool_posix.0 Request processed in 158us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580223.072714:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 17 00000100:00100000:2.0:1787580223.148758:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580223.148848:0:15103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239781504 00000100:00100000:1.0:1787580223.148859:0:15103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239781504 00000100:00100000:1.0:1787580223.148924:0:15103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 18 00000100:00100000:1.0:1787580223.148935:0:15103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7e97d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a27ab63-1899-406a-bdda-fd6b0377149d+9:14480:x1874413239781504:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:1.0:1787580223.148960:0:15103:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787580223.148987:0:15103:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59600/0xc86deac208338ba0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d559 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580223.149078:0:15103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59e00/0xc86deac208338ba7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580223.149093:0:15103:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59e00/0xc86deac208338ba7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580223.149104:0:15103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59e00/0xc86deac208338ba7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580223.149119:0:15103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58e00/0xc86deac208338bae lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580223.149126:0:15103:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58e00/0xc86deac208338bae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580223.149132:0:15103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58e00/0xc86deac208338bae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580223.149574:0:15103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59e00/0xc86deac208338ba7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580223.149583:0:15103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59e00/0xc86deac208338ba7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580223.149590:0:15103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59e00/0xc86deac208338ba7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580223.149596:0:15103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae4ca59e00 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:1.0:1787580223.149612:0:15103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59e00/0xc86deac208338ba7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580223.149628:0:15103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59e00/0xc86deac208338ba7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580223.149643:0:15103:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fae4537f300) 00010000:00010000:1.0:1787580223.149646:0:15103:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787580223.149651:0:15103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59e00/0xc86deac208338ba7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580223.149657:0:15103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59e00/0xc86deac208338ba7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580223.149669:0:15103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58e00/0xc86deac208338bae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580223.149676:0:15103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58e00/0xc86deac208338bae lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580223.149682:0:15103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58e00/0xc86deac208338bae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580223.149687:0:15103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae4ca58e00 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:1.0:1787580223.149690:0:15103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58e00/0xc86deac208338bae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580223.149696:0:15103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58e00/0xc86deac208338bae lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580223.149702:0:15103:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8fae5bb2fc00) 00010000:00010000:1.0:1787580223.149705:0:15103:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787580223.149707:0:15103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58e00/0xc86deac208338bae lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580223.149721:0:15103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58e00/0xc86deac208338bae lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580223.149754:0:15103:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59600/0xc86deac208338ba0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d559 expref: 10 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580223.149763:0:15103:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fae4537f300) 00010000:00010000:1.0:1787580223.149765:0:15103:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787580223.149768:0:15103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59600/0xc86deac208338ba0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d559 expref: 10 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580223.149776:0:15103:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae4ca59600, rc 0) 00000100:00100000:1.0:1787580223.149852:0:15103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7e97d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a27ab63-1899-406a-bdda-fd6b0377149d+9:14480:x1874413239781504:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 918us (1105us total) trans 0 rc 301/301 00000100:00100000:1.0:1787580223.149860:0:15103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 18 00000100:00100000:2.0:1787580223.160077:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580223.160297:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239781632 00000100:00100000:1.0:1787580223.160308:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239781632 00000100:00100000:1.0:1787580223.160371:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 0 00000100:00100000:1.0:1787580223.160403:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7e97dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:1a27ab63-1899-406a-bdda-fd6b0377149d+9:14480:x1874413239781632:12345-192.168.202.36@tcp:700:lfs.0 00000100:00100000:1.0:1787580223.160504:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7e97dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:1a27ab63-1899-406a-bdda-fd6b0377149d+9:14480:x1874413239781632:12345-192.168.202.36@tcp:700:lfs.0 Request processed in 122us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580223.160512:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 0 00000040:00080000:0.0:1787580223.161016:0:14427:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787580223.163003:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580223.172763:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239781888 00000100:00100000:0.0:1787580223.172781:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239781888 00000100:00100000:0.0:1787580223.172873:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 19 00000100:00100000:0.0:1787580223.172885:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7e97fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a27ab63-1899-406a-bdda-fd6b0377149d+9:14480:x1874413239781888:12345-192.168.202.36@tcp:36:lfs.0 00010000:00010000:0.0:1787580223.172980:0:14396:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787580223.173026:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150f200/0xc86deac208338ae3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d4d4 expref: 9 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580223.173051:0:14396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fae4537f300) 00010000:00010000:0.0:1787580223.173057:0:14396:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787580223.173613:0:14396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac208338bb5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580223.173631:0:14396:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea400/0xc86deac208338b1b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d536 expref: 5 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580223.173641:0:14396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac208338bb5 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580223.173679:0:14396:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea400/0xc86deac208338b1b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d536 expref: 5 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580223.174025:0:14396:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea400/0xc86deac208338b1b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d536 expref: 5 pid: 14396 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580223.174048:0:14396:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7ec37480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14396:1874413262842240:192.168.202.36@tcp:104: 00000100:00100000:0.0:1787580223.174201:0:14396:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae5073c840 going to sleep for 11 seconds 00000100:00100000:0.0:1787580223.176769:0:14396:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7ec37480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14396:1874413262842240:192.168.202.36@tcp:104: 00010000:00010000:0.0:1787580223.177066:0:14396:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac208338bb5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580223.185958:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580223.186326:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239782016 00000100:00100000:3.0:1787580223.186338:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239782016 00010000:00010000:3.0:1787580223.186448:0:14381:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea400/0xc86deac208338b1b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d536 expref: 6 pid: 14396 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580223.186492:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 9 00000100:00100000:3.0:1787580223.186516:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7463a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:83858f7d-0f97-4f68-815c-0077941bf864+6:2360:x1874413239782016:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787580223.186543:0:14381:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787580223.186560:0:14381:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea400/0xc86deac208338b1b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d536 expref: 6 pid: 14396 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580223.186575:0:14381:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea400/0xc86deac208338b1b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d536 expref: 6 pid: 14396 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580223.186608:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae50fea400/0xc86deac208338b1b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d536 expref: 6 pid: 14396 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580223.186626:0:14381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fae4537f300) 00010000:00010000:3.0:1787580223.186632:0:14381:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac208338bb5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580223.186642:0:14381:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac208338bb5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580223.186649:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac208338bb5 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580223.186679:0:14381:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787580223.186743:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7463a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:83858f7d-0f97-4f68-815c-0077941bf864+5:2360:x1874413239782016:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 229us (795us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580223.186750:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 9 00000100:00080000:2.0:1787580223.187123:0:14391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787580223.187497:0:14396:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac208338bb5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580223.187509:0:14396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac208338bb5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580223.187707:0:14396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59600/0xc86deac208338bbc lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580223.187719:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59600/0xc86deac208338bbc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580223.187728:0:14396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59600/0xc86deac208338bbc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787580223.197876:0:14396:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1787580223.197900:0:14396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac208338bb5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580223.197912:0:14396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac208338bb5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580223.197920:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac208338bb5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580223.197927:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db8200 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:1.0:1787580223.201407:0:14396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac208338bb5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580223.201442:0:14396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac208338bb5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580223.201464:0:14396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fae4537f300) 00010000:00010000:1.0:1787580223.201468:0:14396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787580223.201474:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac208338bb5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580223.202703:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac208338bb5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787580223.202737:0:14396:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000048d7c8e3 reply state 00000000decb1ac6 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59600/0xc86deac208338bbc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580223.202749:0:14396:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787580223.204058:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7e97fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a27ab63-1899-406a-bdda-fd6b0377149d+10:14480:x1874413239781888:12345-192.168.202.36@tcp:36:lfs.0 Request processed in 31163us (41056us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1787580223.204070:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 19 00010000:00010000:3.0:1787580223.220743:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59600/0xc86deac208338bbc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580223.220765:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59600/0xc86deac208338bbc lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580223.220787:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59600/0xc86deac208338bbc lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580223.220794:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae4ca59600 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:3.0:1787580223.220799:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59600/0xc86deac208338bbc lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580223.220807:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59600/0xc86deac208338bbc lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580223.220826:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8fae5bb2fc00) 00010000:00010000:3.0:1787580223.220829:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787580223.220834:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59600/0xc86deac208338bbc lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580223.220841:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59600/0xc86deac208338bbc lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580223.322085:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580223.322197:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239782144 00000100:00100000:2.0:1787580223.322207:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239782144 00000100:00100000:2.0:1787580223.322271:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 20 00000100:00100000:2.0:1787580223.322281:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7ec37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a27ab63-1899-406a-bdda-fd6b0377149d+9:14488:x1874413239782144:12345-192.168.202.36@tcp:101:lctl.0 00010000:00010000:2.0:1787580223.322303:0:14397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787580223.322331:0:14397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb7400/0xc86deac208338bc3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d560 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580223.322443:0:14397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb6000/0xc86deac208338bca lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580223.322457:0:14397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb6000/0xc86deac208338bca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580223.322481:0:14397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb6000/0xc86deac208338bca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787580223.322551:0:14397:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787580223.322555:0:14397:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:2.0:1787580223.322597:0:14397:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb6000/0xc86deac208338bca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580223.322633:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb7400/0xc86deac208338bc3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d560 expref: 11 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580223.322657:0:14397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb6000/0xc86deac208338bca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d560 expref: 10 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580223.322665:0:14397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fae5dce6700) 00010000:00010000:2.0:1787580223.322668:0:14397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787580223.322671:0:14397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae6dfb6000, rc 0) 00000100:00100000:2.0:1787580223.322733:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7ec37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a27ab63-1899-406a-bdda-fd6b0377149d+10:14488:x1874413239782144:12345-192.168.202.36@tcp:101:lctl.0 Request processed in 452us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580223.322740:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 20 00000100:00100000:1.0:1787580223.370292:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580223.370491:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239782272 00000100:00100000:2.0:1787580223.370505:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239782272 00000100:00100000:2.0:1787580223.370587:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 21 00000100:00100000:2.0:1787580223.370632:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51caed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83858f7d-0f97-4f68-815c-0077941bf864+5:14489:x1874413239782272:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:2.0:1787580223.370667:0:14395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787580223.370693:0:14395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb7400/0xc86deac208338bd1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d567 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580223.370796:0:14395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb6a00/0xc86deac208338bd8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580223.370812:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb6a00/0xc86deac208338bd8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580223.370824:0:14395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb6a00/0xc86deac208338bd8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787580223.370892:0:14395:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787580223.370896:0:14395:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:2.0:1787580223.370919:0:14395:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb6a00/0xc86deac208338bd8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580223.370945:0:14395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb7400/0xc86deac208338bd1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d567 expref: 7 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580223.370966:0:14395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb6a00/0xc86deac208338bd8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d567 expref: 6 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580223.370975:0:14395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fae5dce6700) 00010000:00010000:2.0:1787580223.370977:0:14395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787580223.370981:0:14395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae6dfb6a00, rc 0) 00000100:00100000:2.0:1787580223.371054:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51caed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83858f7d-0f97-4f68-815c-0077941bf864+6:14489:x1874413239782272:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 457us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580223.371061:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 21 00000100:00100000:3.0:1787580223.376722:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580223.376824:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239782400 00000100:00100000:2.0:1787580223.376836:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239782400 00000100:00100000:2.0:1787580223.376924:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 22 00000100:00100000:2.0:1787580223.376945:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83858f7d-0f97-4f68-815c-0077941bf864+6:14489:x1874413239782400:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:2.0:1787580223.376967:0:14397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787580223.376988:0:14397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb7400/0xc86deac208338bdf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d56e expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580223.377053:0:14397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb7000/0xc86deac208338be6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580223.377068:0:14397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb7000/0xc86deac208338be6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580223.377080:0:14397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb7000/0xc86deac208338be6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580223.377107:0:14397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb6800/0xc86deac208338bed lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580223.377115:0:14397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb6800/0xc86deac208338bed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580223.377123:0:14397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb6800/0xc86deac208338bed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580223.377232:0:14397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb6400/0xc86deac208338bf4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580223.377239:0:14397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb6400/0xc86deac208338bf4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580223.377246:0:14397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb6400/0xc86deac208338bf4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787580223.377299:0:14397:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1787580223.377303:0:14397:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787580223.377327:0:14397:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb6400/0xc86deac208338bf4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580223.377340:0:14397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb7000/0xc86deac208338be6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580223.377347:0:14397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb7000/0xc86deac208338be6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580223.377365:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb7000/0xc86deac208338be6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580223.377372:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae6dfb7000 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:2.0:1787580223.377377:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb7000/0xc86deac208338be6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580223.377409:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb7000/0xc86deac208338be6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580223.377675:0:14397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fae5dce6700) 00010000:00010000:2.0:1787580223.377679:0:14397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787580223.377685:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb7000/0xc86deac208338be6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580223.377691:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb7000/0xc86deac208338be6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580223.377710:0:14397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb6800/0xc86deac208338bed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580223.377728:0:14397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb6800/0xc86deac208338bed lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580223.377734:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb6800/0xc86deac208338bed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580223.377740:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae6dfb6800 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:2.0:1787580223.377743:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb6800/0xc86deac208338bed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580223.377749:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb6800/0xc86deac208338bed lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580223.377757:0:14397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8fae5dce6800) 00010000:00010000:2.0:1787580223.377760:0:14397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787580223.377762:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb6800/0xc86deac208338bed lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580223.377768:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb6800/0xc86deac208338bed lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580223.377797:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb7400/0xc86deac208338bdf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d56e expref: 8 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580223.377812:0:14397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb6400/0xc86deac208338bf4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d56e expref: 7 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580223.377820:0:14397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8fae5dce6000) 00010000:00010000:2.0:1787580223.377822:0:14397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787580223.377830:0:14397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae6dfb6400, rc 0) 00000100:00100000:2.0:1787580223.377906:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83858f7d-0f97-4f68-815c-0077941bf864+7:14489:x1874413239782400:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 963us (1195us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580223.377914:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 22 00000100:00100000:0.0:1787580223.384488:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580223.386950:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239782656 00000100:00100000:2.0:1787580223.386967:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239782656 00000100:00100000:2.0:1787580223.387048:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 23 00000100:00100000:2.0:1787580223.387060:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7ec37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83858f7d-0f97-4f68-815c-0077941bf864+7:14489:x1874413239782656:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:2.0:1787580223.387082:0:14395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787580223.387107:0:14395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb7400/0xc86deac208338bfb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d575 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787580223.387235:0:14395:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787580223.387468:0:14395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb7400/0xc86deac208338bfb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d575 expref: 9 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580223.387484:0:14395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fae5dce6700) 00010000:00010000:2.0:1787580223.387487:0:14395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787580223.387493:0:14395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb7400/0xc86deac208338bfb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d575 expref: 9 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580223.387511:0:14395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae6dfb7400, rc 0) 00000100:00100000:2.0:1787580223.387716:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7ec37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83858f7d-0f97-4f68-815c-0077941bf864+8:14489:x1874413239782656:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 658us (3240us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1787580223.387724:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 23 00000100:00100000:3.0:1787580223.390690:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580223.390804:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239782912 00000100:00100000:2.0:1787580223.390816:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239782912 00000100:00100000:2.0:1787580223.390888:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 24 00000100:00100000:2.0:1787580223.390915:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83858f7d-0f97-4f68-815c-0077941bf864+8:14489:x1874413239782912:12345-192.168.202.36@tcp:36:lfs.0 00010000:00010000:2.0:1787580223.390982:0:14397:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787580223.391012:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb6400/0xc86deac208338bf4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d56e expref: 8 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580223.391032:0:14397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8fae5dce6000) 00010000:00010000:2.0:1787580223.391041:0:14397:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787580223.391068:0:14397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb6800/0xc86deac208338c09 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580223.391081:0:14397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb6800/0xc86deac208338c09 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580223.391090:0:14397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb6800/0xc86deac208338c09 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787580223.391342:0:14397:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a11499a0 reply state 00000000ce00933f transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb6800/0xc86deac208338c09 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580223.391352:0:14397:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787580223.391377:0:14397:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:2.0:1787580223.391493:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83858f7d-0f97-4f68-815c-0077941bf864+9:14489:x1874413239782912:12345-192.168.202.36@tcp:36:lfs.0 Request processed in 581us (814us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1787580223.391501:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 24 00010000:00010000:2.0:1787580223.393923:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb6800/0xc86deac208338c09 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580223.393942:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb6800/0xc86deac208338c09 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580223.393950:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb6800/0xc86deac208338c09 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580223.393969:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae6dfb6800 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:2.0:1787580223.393974:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb6800/0xc86deac208338c09 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580223.393982:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb6800/0xc86deac208338c09 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580223.394000:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8fae5dce6800) 00010000:00010000:2.0:1787580223.394003:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1787580223.394008:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb6800/0xc86deac208338c09 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580223.394014:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb6800/0xc86deac208338c09 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580223.394531:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580223.394627:0:14398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239783168 00000100:00100000:1.0:1787580223.394638:0:14398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239783168 00000100:00100000:1.0:1787580223.394693:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 2 00000100:00100000:1.0:1787580223.394704:0:14398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:83858f7d-0f97-4f68-815c-0077941bf864+8:14489:x1874413239783168:12345-192.168.202.36@tcp:35:lfs.0 00000100:00100000:1.0:1787580223.395183:0:14398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:83858f7d-0f97-4f68-815c-0077941bf864+9:14489:x1874413239783168:12345-192.168.202.36@tcp:35:lfs.0 Request processed in 479us (666us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1787580223.395192:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 2 00000100:00100000:3.0:1787580223.404810:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580223.404904:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239783424 00000100:00100000:0.0:1787580223.404926:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239783424 00000100:00100000:0.0:1787580223.405032:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 25 00000100:00100000:0.0:1787580223.405052:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83858f7d-0f97-4f68-815c-0077941bf864+9:14489:x1874413239783424:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:0.0:1787580223.405076:0:14395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787580223.405097:0:14395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9600/0xc86deac208338c10 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d57c expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580223.405172:0:14395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac208338c17 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580223.405186:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac208338c17 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580223.405197:0:14395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac208338c17 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580223.405211:0:14395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208338c1e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580223.405217:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208338c1e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580223.405223:0:14395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208338c1e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787580223.405352:0:14395:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1787580223.405493:0:14395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac208338c17 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580223.405501:0:14395:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac208338c17 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580223.405529:0:14395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac208338c17 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580223.405536:0:14395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db8200 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:0.0:1787580223.405541:0:14395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac208338c17 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580223.405549:0:14395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac208338c17 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580223.405561:0:14395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fae5dce6700) 00010000:00010000:0.0:1787580223.405564:0:14395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787580223.405581:0:14395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac208338c17 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580223.405588:0:14395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8200/0xc86deac208338c17 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580223.405611:0:14395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208338c1e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580223.405617:0:14395:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208338c1e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580223.405623:0:14395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208338c1e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580223.405627:0:14395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db9000 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:0.0:1787580223.405630:0:14395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208338c1e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580223.405646:0:14395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208338c1e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580223.405654:0:14395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8fae56e35200) 00010000:00010000:0.0:1787580223.405656:0:14395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787580223.405659:0:14395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208338c1e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580223.405665:0:14395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208338c1e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580223.405709:0:14395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9600/0xc86deac208338c10 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d57c expref: 11 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580223.405720:0:14395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fae5dce6700) 00010000:00010000:0.0:1787580223.405722:0:14395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787580223.405726:0:14395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9600/0xc86deac208338c10 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d57c expref: 11 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580223.405736:0:14395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae48db9600, rc 0) 00000100:00100000:0.0:1787580223.405802:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83858f7d-0f97-4f68-815c-0077941bf864+10:14489:x1874413239783424:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 760us (1003us total) trans 8589934598 rc 301/301 00000100:00100000:0.0:1787580223.405810:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 25 00000100:00100000:0.0:1787580223.412289:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580223.412375:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239783552 00000100:00100000:3.0:1787580223.412433:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239783552 00000100:00100000:3.0:1787580223.412493:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 26 00000100:00100000:3.0:1787580223.412504:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7ec37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83858f7d-0f97-4f68-815c-0077941bf864+10:14489:x1874413239783552:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:3.0:1787580223.412542:0:14397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787580223.412579:0:14397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150ee00/0xc86deac208338c2c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d583 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580223.412707:0:14397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150fe00/0xc86deac208338c33 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580223.412722:0:14397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150fe00/0xc86deac208338c33 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580223.412734:0:14397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150fe00/0xc86deac208338c33 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787580223.412786:0:14397:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:3.0:1787580223.412789:0:14397:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787580223.412816:0:14397:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150fe00/0xc86deac208338c33 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580223.412844:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150ee00/0xc86deac208338c2c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d583 expref: 12 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580223.412864:0:14397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150fe00/0xc86deac208338c33 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d583 expref: 11 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580223.412872:0:14397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8fae4537f500) 00010000:00010000:3.0:1787580223.412875:0:14397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787580223.412879:0:14397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae4150fe00, rc 0) 00000100:00100000:3.0:1787580223.412939:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7ec37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83858f7d-0f97-4f68-815c-0077941bf864+11:14489:x1874413239783552:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 437us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580223.412946:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 26 00000100:00100000:3.0:1787580223.431012:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580223.431337:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239783680 00000100:00100000:2.0:1787580223.431352:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239783680 00000100:00100000:2.0:1787580223.431463:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 3 00000100:00100000:2.0:1787580223.431475:0:14399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:83858f7d-0f97-4f68-815c-0077941bf864+11:14489:x1874413239783680:12345-192.168.202.36@tcp:37:lfs.0 00000100:00100000:2.0:1787580223.440025:0:14399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:83858f7d-0f97-4f68-815c-0077941bf864+11:14489:x1874413239783680:12345-192.168.202.36@tcp:37:lfs.0 Request processed in 8536us (9008us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580223.440040:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 3 00000100:00100000:0.0:1787580223.448159:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580223.449925:0:14398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239783936 00000100:00100000:1.0:1787580223.449941:0:14398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239783936 00000100:00100000:1.0:1787580223.450026:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 4 00000100:00100000:1.0:1787580223.450038:0:14398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d756850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:83858f7d-0f97-4f68-815c-0077941bf864+11:14489:x1874413239783936:12345-192.168.202.36@tcp:35:lfs.0 00000100:00100000:1.0:1787580223.450322:0:14398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d756850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:83858f7d-0f97-4f68-815c-0077941bf864+12:14489:x1874413239783936:12345-192.168.202.36@tcp:35:lfs.0 Request processed in 285us (2173us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1787580223.450330:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 4 00000100:00100000:3.0:1787580223.586977:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580223.587147:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239784064 00000100:00100000:1.0:1787580223.587165:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239784064 00000100:00100000:1.0:1787580223.587234:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 27 00000100:00100000:1.0:1787580223.587246:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a27ab63-1899-406a-bdda-fd6b0377149d+10:14496:x1874413239784064:12345-192.168.202.36@tcp:101:bash.0 00010000:00010000:1.0:1787580223.587268:0:14396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787580223.587291:0:14396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58e00/0xc86deac208338c3a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d58a expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580223.587365:0:14396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59e00/0xc86deac208338c41 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580223.587425:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59e00/0xc86deac208338c41 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580223.587438:0:14396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59e00/0xc86deac208338c41 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580223.587455:0:14396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58a00/0xc86deac208338c48 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580223.587463:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58a00/0xc86deac208338c48 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580223.587470:0:14396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58a00/0xc86deac208338c48 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580223.587589:0:14396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59800/0xc86deac208338c4f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580223.587614:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59800/0xc86deac208338c4f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580223.587621:0:14396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59800/0xc86deac208338c4f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787580223.587673:0:14396:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:1.0:1787580223.587677:0:14396:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787580223.587722:0:14396:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59800/0xc86deac208338c4f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580223.587735:0:14396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59e00/0xc86deac208338c41 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580223.587742:0:14396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59e00/0xc86deac208338c41 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580223.587748:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59e00/0xc86deac208338c41 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580223.587754:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae4ca59e00 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:1.0:1787580223.587759:0:14396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59e00/0xc86deac208338c41 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580223.587767:0:14396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59e00/0xc86deac208338c41 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580223.587780:0:14396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fae5dce6700) 00010000:00010000:1.0:1787580223.587783:0:14396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787580223.587787:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59e00/0xc86deac208338c41 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580223.587793:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59e00/0xc86deac208338c41 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580223.587806:0:14396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58a00/0xc86deac208338c48 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580223.587818:0:14396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58a00/0xc86deac208338c48 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580223.587822:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58a00/0xc86deac208338c48 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580223.587824:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae4ca58a00 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:1.0:1787580223.587826:0:14396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58a00/0xc86deac208338c48 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580223.587829:0:14396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58a00/0xc86deac208338c48 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580223.587834:0:14396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8fae5bb2f000) 00010000:00010000:1.0:1787580223.587836:0:14396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787580223.587837:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58a00/0xc86deac208338c48 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580223.587841:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58a00/0xc86deac208338c48 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580223.587864:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58e00/0xc86deac208338c3a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d58a expref: 12 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580223.587872:0:14396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59800/0xc86deac208338c4f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d58a expref: 11 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580223.587877:0:14396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8fae4537f500) 00010000:00010000:1.0:1787580223.587878:0:14396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787580223.587884:0:14396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae4ca59800, rc 0) 00000100:00100000:1.0:1787580223.587956:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a27ab63-1899-406a-bdda-fd6b0377149d+11:14496:x1874413239784064:12345-192.168.202.36@tcp:101:bash.0 Request processed in 712us (990us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580223.587965:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 27 00000100:00100000:0.0:1787580223.595721:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580223.596019:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239784320 00000100:00100000:3.0:1787580223.596030:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239784320 00000100:00100000:3.0:1787580223.596101:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 28 00000100:00100000:3.0:1787580223.596113:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7ec35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a27ab63-1899-406a-bdda-fd6b0377149d+11:14496:x1874413239784320:12345-192.168.202.36@tcp:101:bash.0 00010000:00010000:3.0:1787580223.596140:0:14397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787580223.596165:0:14397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150ee00/0xc86deac208338c56 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d591 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580223.596309:0:14397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150f200/0xc86deac208338c5d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580223.596325:0:14397:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150fe00/0xc86deac208338c33 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d583 expref: 11 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580223.596333:0:14397:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150f200/0xc86deac208338c5d lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580223.596370:0:14397:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150fe00/0xc86deac208338c33 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d583 expref: 11 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580223.596440:0:14397:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150fe00/0xc86deac208338c33 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d583 expref: 11 pid: 14397 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580223.596456:0:14397:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae779b8000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14397:1874413262842368:192.168.202.36@tcp:104: 00000100:00100000:3.0:1787580223.596561:0:14397:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae5061b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787580223.600056:0:14397:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae779b8000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14397:1874413262842368:192.168.202.36@tcp:104: 00010000:00010000:2.0:1787580223.600087:0:14397:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150f200/0xc86deac208338c5d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580223.601983:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580223.602167:0:16515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239784448 00000100:00100000:1.0:1787580223.602177:0:16515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239784448 00010000:00010000:1.0:1787580223.602221:0:16515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150fe00/0xc86deac208338c33 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d583 expref: 12 pid: 14397 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580223.602263:0:16515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 10 00000100:00100000:1.0:1787580223.602272:0:16515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7ec34000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:83858f7d-0f97-4f68-815c-0077941bf864+12:2361:x1874413239784448:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787580223.602286:0:16515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787580223.602294:0:16515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150fe00/0xc86deac208338c33 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d583 expref: 12 pid: 14397 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580223.602306:0:16515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150fe00/0xc86deac208338c33 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d583 expref: 12 pid: 14397 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580223.602331:0:16515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150fe00/0xc86deac208338c33 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d583 expref: 12 pid: 14397 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580223.602351:0:16515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8fae4537f500) 00010000:00010000:1.0:1787580223.602356:0:16515:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150f200/0xc86deac208338c5d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580223.602366:0:16515:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150f200/0xc86deac208338c5d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580223.602372:0:16515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150f200/0xc86deac208338c5d lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580223.602476:0:16515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787580223.602528:0:16515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7ec34000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:83858f7d-0f97-4f68-815c-0077941bf864+11:2361:x1874413239784448:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 257us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580223.602536:0:16515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 10 00010000:00010000:3.0:1787580223.604293:0:14397:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150f200/0xc86deac208338c5d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580223.604328:0:14397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150f200/0xc86deac208338c5d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580223.604567:0:14397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb6800/0xc86deac208338c64 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580223.604592:0:14397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb6800/0xc86deac208338c64 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580223.604615:0:14397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb6800/0xc86deac208338c64 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580223.606487:0:14397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb6400/0xc86deac208338c6b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580223.608635:0:14397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb6400/0xc86deac208338c6b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580223.608657:0:14397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb6400/0xc86deac208338c6b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787580223.608678:0:14397:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787580223.608740:0:14397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150f200/0xc86deac208338c5d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580223.608748:0:14397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150f200/0xc86deac208338c5d lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580223.608756:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150f200/0xc86deac208338c5d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580223.608762:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae4150f200 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:2.0:1787580223.608766:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150f200/0xc86deac208338c5d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580223.608773:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150f200/0xc86deac208338c5d lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580223.609297:0:14397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8fae4537f500) 00010000:00010000:2.0:1787580223.609303:0:14397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787580223.609309:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150f200/0xc86deac208338c5d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580223.609317:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150f200/0xc86deac208338c5d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787580223.609338:0:14397:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000018bfc033 reply state 0000000036a2cdcb transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb6800/0xc86deac208338c64 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580223.609348:0:14397:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787580223.609500:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150ee00/0xc86deac208338c56 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d591 expref: 14 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580223.609526:0:14397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb6400/0xc86deac208338c6b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d591 expref: 13 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580223.609534:0:14397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8fae5dce6000) 00010000:00010000:2.0:1787580223.609536:0:14397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1787580223.609539:0:14397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae6dfb6400, rc 0) 00000100:00100000:2.0:1787580223.609632:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7ec35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a27ab63-1899-406a-bdda-fd6b0377149d+14:14496:x1874413239784320:12345-192.168.202.36@tcp:101:bash.0 Request processed in 13520us (13921us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1787580223.609640:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 28 00000100:00100000:3.0:1787580223.616588:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787580223.616621:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae779ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874413262842496:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787580223.616689:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580223.617471:0:15082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262842496 00000100:00100000:0.0:1787580223.617490:0:15082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262842496 00000100:00100000:0.0:1787580223.617564:0:15082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787580223.617575:0:15082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874413262842496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787580223.617622:0:15082:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787580223.617683:0:15082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874413262842496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (994us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580223.617691:0:15082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1787580223.618001:0:14391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787580223.618668:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae779ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874413262842496:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787580223.622132:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb6800/0xc86deac208338c64 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580223.622150:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb6800/0xc86deac208338c64 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580223.622158:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb6800/0xc86deac208338c64 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580223.622164:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae6dfb6800 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:3.0:1787580223.622169:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb6800/0xc86deac208338c64 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580223.622177:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb6800/0xc86deac208338c64 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580223.622194:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8fae5dce6800) 00010000:00010000:3.0:1787580223.622197:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787580223.622201:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb6800/0xc86deac208338c64 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580223.622206:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb6800/0xc86deac208338c64 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580223.655364:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580223.657166:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239784576 00000100:00100000:3.0:1787580223.657193:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239784576 00000100:00100000:3.0:1787580223.657257:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 29 00000100:00100000:3.0:1787580223.657268:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7ec37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a27ab63-1899-406a-bdda-fd6b0377149d+13:14496:x1874413239784576:12345-192.168.202.36@tcp:101:bash.0 00010000:00010000:3.0:1787580223.657291:0:14396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787580223.657313:0:14396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150e400/0xc86deac208338c79 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d598 expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580223.657404:0:14396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150fc00/0xc86deac208338c80 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580223.657432:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150fc00/0xc86deac208338c80 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580223.657445:0:14396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150fc00/0xc86deac208338c80 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787580223.657484:0:14396:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1787580223.657489:0:14396:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787580223.657512:0:14396:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150fc00/0xc86deac208338c80 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580223.657532:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150fc00/0xc86deac208338c80 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580223.657557:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150e400/0xc86deac208338c79 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d598 expref: 15 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580223.657575:0:14396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150fc00/0xc86deac208338c80 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d598 expref: 14 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580223.657584:0:14396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8fae5dce6000) 00010000:00010000:3.0:1787580223.657593:0:14396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787580223.657607:0:14396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae4150fc00, rc 0) 00000100:00100000:3.0:1787580223.657671:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7ec37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a27ab63-1899-406a-bdda-fd6b0377149d+14:14496:x1874413239784576:12345-192.168.202.36@tcp:101:bash.0 Request processed in 404us (2316us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580223.657678:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 29 00000100:00100000:3.0:1787580223.666159:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580223.666369:0:14398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239784832 00000100:00100000:0.0:1787580223.666421:0:14398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239784832 00000100:00100000:0.0:1787580223.666482:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 5 00000100:00100000:0.0:1787580223.666492:0:14398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a27ab63-1899-406a-bdda-fd6b0377149d+14:14496:x1874413239784832:12345-192.168.202.36@tcp:35:bash.0 00000100:00100000:0.0:1787580223.667430:0:14398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a27ab63-1899-406a-bdda-fd6b0377149d+15:14496:x1874413239784832:12345-192.168.202.36@tcp:35:bash.0 Request processed in 928us (1274us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1787580223.667441:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 5 00000001:00080000:0.0:1787580223.727948:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000001:00080000:0.0:1787580223.727968:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934593 is committed 00000001:00080000:0.0:1787580223.727975:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000001:00080000:0.0:1787580223.727981:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934594 is committed 00000001:00080000:0.0:1787580223.727986:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934600 is committed 00010000:00010000:3.0:1787580223.733169:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787580223.802759:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580223.803229:0:15103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239785088 00000100:00100000:1.0:1787580223.803241:0:15103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239785088 00000100:00100000:1.0:1787580223.803307:0:15103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 30 00000100:00100000:1.0:1787580223.803318:0:15103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7463b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a27ab63-1899-406a-bdda-fd6b0377149d+12:14506:x1874413239785088:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:1.0:1787580223.803344:0:15103:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787580223.803366:0:15103:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58e00/0xc86deac208338c87 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d59f expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787580223.803922:0:15103:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1787580223.804104:0:15103:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58e00/0xc86deac208338c87 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d59f expref: 14 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580223.804120:0:15103:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8fae5dce6700) 00010000:00010000:1.0:1787580223.804123:0:15103:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787580223.804129:0:15103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58e00/0xc86deac208338c87 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d59f expref: 14 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580223.804143:0:15103:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae4ca58e00, rc 0) 00000100:00100000:1.0:1787580223.804218:0:15103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7463b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a27ab63-1899-406a-bdda-fd6b0377149d+13:14506:x1874413239785088:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 901us (1469us total) trans 8589934602 rc 301/301 00000100:00100000:1.0:1787580223.804226:0:15103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 30 00000100:00100000:3.0:1787580223.811696:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580223.811819:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239785344 00000100:00100000:2.0:1787580223.811831:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239785344 00000100:00100000:2.0:1787580223.811892:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 6 00000100:00100000:2.0:1787580223.811921:0:14399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a27ab63-1899-406a-bdda-fd6b0377149d+13:14506:x1874413239785344:12345-192.168.202.36@tcp:35:lfs.0 00000100:00100000:2.0:1787580223.812502:0:14399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a27ab63-1899-406a-bdda-fd6b0377149d+14:14506:x1874413239785344:12345-192.168.202.36@tcp:35:lfs.0 Request processed in 583us (815us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1787580223.812511:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 6 00000100:00100000:3.0:1787580223.860938:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580223.861307:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239785600 00000100:00100000:1.0:1787580223.861333:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239785600 00000100:00100000:1.0:1787580223.861439:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 31 00000100:00100000:1.0:1787580223.861451:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a27ab63-1899-406a-bdda-fd6b0377149d+14:14509:x1874413239785600:12345-192.168.202.36@tcp:101:lfs.0 00010000:00010000:1.0:1787580223.861480:0:14396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787580223.861502:0:14396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58e00/0xc86deac208338c95 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d5a6 expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580223.861628:0:14396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58a00/0xc86deac208338c9c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580223.861643:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58a00/0xc86deac208338c9c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580223.861654:0:14396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58a00/0xc86deac208338c9c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787580223.861667:0:14396:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787580223.861797:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58e00/0xc86deac208338c95 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d5a6 expref: 17 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580223.861818:0:14396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58a00/0xc86deac208338c9c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d5a6 expref: 16 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580223.861828:0:14396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8fae5dce6000) 00010000:00010000:1.0:1787580223.861831:0:14396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787580223.861835:0:14396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae4ca58a00, rc 0) 00000100:00100000:1.0:1787580223.861899:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a27ab63-1899-406a-bdda-fd6b0377149d+16:14509:x1874413239785600:12345-192.168.202.36@tcp:101:lfs.0 Request processed in 449us (972us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1787580223.861906:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 31 00000100:00100000:3.0:1787580223.870227:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580223.870276:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580223.870362:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239785856 00000100:00100000:0.0:1787580223.870374:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239785856 00000100:00100000:0.0:1787580223.870494:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 0 00000100:00100000:0.0:1787580223.870506:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1a27ab63-1899-406a-bdda-fd6b0377149d+16:2360:x1874413239785856:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787580223.870533:0:14382:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787580223.870565:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca58a00/0xc86deac208338c9c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d5a6 expref: 16 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580223.870620:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8fae5dce6000) 00010000:00010000:0.0:1787580223.870625:0:14382:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787580223.870693:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1a27ab63-1899-406a-bdda-fd6b0377149d+15:2360:x1874413239785856:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 188us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580223.870701:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 0 00000100:00100000:2.0:1787580223.870878:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239785728 00000100:00100000:2.0:1787580223.870883:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239785728 00000100:00100000:2.0:1787580223.870929:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 32 00000100:00100000:2.0:1787580223.870937:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a27ab63-1899-406a-bdda-fd6b0377149d+15:14509:x1874413239785728:12345-192.168.202.36@tcp:54:lfs.0 00010000:00010000:2.0:1787580223.871000:0:14397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb7000/0xc86deac208338caa lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580223.871015:0:14397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb7000/0xc86deac208338caa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580223.871025:0:14397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb7000/0xc86deac208338caa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580223.871053:0:14397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb7000/0xc86deac208338caa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580223.871060:0:14397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb7000/0xc86deac208338caa lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580223.871066:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb7000/0xc86deac208338caa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580223.871071:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae6dfb7000 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:2.0:1787580223.871076:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb7000/0xc86deac208338caa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580223.871095:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb7000/0xc86deac208338caa lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580223.871104:0:14397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8fae5dce6000) 00010000:00010000:2.0:1787580223.871107:0:14397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787580223.871110:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb7000/0xc86deac208338caa lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580223.871115:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb7000/0xc86deac208338caa lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580223.871164:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a27ab63-1899-406a-bdda-fd6b0377149d+15:14509:x1874413239785728:12345-192.168.202.36@tcp:54:lfs.0 Request processed in 223us (944us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580223.871171:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 32 00000100:00100000:3.0:1787580223.874283:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580223.874710:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239786112 00000100:00100000:2.0:1787580223.874722:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239786112 00000100:00100000:2.0:1787580223.874797:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 7 00000100:00100000:2.0:1787580223.874809:0:14399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a27ab63-1899-406a-bdda-fd6b0377149d+15:14509:x1874413239786112:12345-192.168.202.36@tcp:35:lfs.0 00000100:00100000:2.0:1787580223.875311:0:14399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a27ab63-1899-406a-bdda-fd6b0377149d+16:14509:x1874413239786112:12345-192.168.202.36@tcp:35:lfs.0 Request processed in 503us (1036us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1787580223.875318:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 7 00000100:00100000:1.0:1787580224.117436:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae51cadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874413262842880:0@lo:400:kworker.0 00000100:00100000:1.0:1787580224.117508:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787580224.117582:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787580224.117589:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae51caf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5949e638-96f6-489a-aea1-b9b80ed3224f:3317:1874413262842752:0@lo:400:kworker.0 00000100:00100000:1.0:1787580224.117650:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787580224.117671:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae51cac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1874413262843264:0@lo:400:kworker.0 00000100:00100000:1.0:1787580224.117696:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787580224.117726:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262843264 00000100:00100000:1.0:1787580224.117748:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262843264 00000100:00100000:1.0:1787580224.117799:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787580224.117808:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51cae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1874413262843264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787580224.117856:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51cae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1874413262843264:12345-0@lo:400:kworker.0 Request processed in 49us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580224.117864:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787580224.117900:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae51cac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3317:1874413262843264:0@lo:400:kworker.0 00000100:00100000:0.0:1787580224.118174:0:15078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262842880 00000100:00100000:0.0:1787580224.118179:0:15078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262842880 00000100:00100000:0.0:1787580224.118211:0:15078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787580224.118217:0:15078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51cad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1874413262842880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787580224.118260:0:15078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51cad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1874413262842880:12345-0@lo:400:kworker.0 Request processed in 43us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580224.118267:0:15078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787580224.118285:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262842752 00000100:00100000:0.0:1787580224.118289:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262842752 00000100:00100000:0.0:1787580224.118311:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1787580224.118318:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7f767450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5949e638-96f6-489a-aea1-b9b80ed3224f+19:3317:x1874413262842752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787580224.118346:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7f767450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5949e638-96f6-489a-aea1-b9b80ed3224f+19:3317:x1874413262842752:12345-0@lo:400:kworker.0 Request processed in 29us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580224.118352:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:0.0:1787580224.118375:0:14391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787580224.118379:0:14391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787580224.118457:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae51caf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5949e638-96f6-489a-aea1-b9b80ed3224f:3317:1874413262842752:0@lo:400:kworker.0 00000100:00100000:0.0:1787580224.118468:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae51cadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874413262842880:0@lo:400:kworker.0 00000100:00100000:2.0:1787580224.118654:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae51caea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874413262843008:0@lo:400:kworker.0 00000100:00100000:2.0:1787580224.118688:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787580224.118723:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787580224.118742:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7ec34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874413262842624:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787580224.118767:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787580224.118787:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae51cace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874413262843136:0@lo:400:kworker.0 00000100:00100000:2.0:1787580224.118825:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787580224.118857:0:15082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262842624 00000100:00100000:2.0:1787580224.118862:0:15082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262842624 00000100:00100000:2.0:1787580224.118888:0:15082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787580224.118896:0:15082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7463b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874413262842624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787580224.118927:0:15082:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787580224.118976:0:15082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7463b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874413262842624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580224.118983:0:15082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787580224.119023:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7ec34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3314:1874413262842624:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787580224.119220:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262843008 00000100:00100000:0.0:1787580224.119230:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262843008 00000100:00100000:0.0:1787580224.119265:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262843136 00000100:00100000:0.0:1787580224.119268:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262843136 00000100:00100000:0.0:1787580224.119294:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787580224.119300:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74638e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874413262843008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787580224.119336:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74638e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874413262843008:12345-0@lo:400:kworker.0 Request processed in 36us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580224.119342:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787580224.119353:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787580224.119359:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74639500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874413262843136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787580224.119409:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74639500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874413262843136:12345-0@lo:400:kworker.0 Request processed in 50us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580224.119415:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1787580224.119430:0:14391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787580224.121434:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae51cace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874413262843136:0@lo:400:kworker.0 00000100:00100000:2.0:1787580224.121453:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae51caea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874413262843008:0@lo:400:kworker.0 00000100:00100000:0.0:1787580224.193225:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580224.193326:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239786368 00000100:00100000:2.0:1787580224.193338:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239786368 00000100:00100000:2.0:1787580224.193454:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 33 00000100:00100000:2.0:1787580224.193467:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7ec34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a27ab63-1899-406a-bdda-fd6b0377149d+16:14540:x1874413239786368:12345-192.168.202.36@tcp:101:cat.0 00010000:00010000:2.0:1787580224.193491:0:14397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787580224.193519:0:14397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb7000/0xc86deac208338cb1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d5ad expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580224.193634:0:14397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb7a00/0xc86deac208338cb8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580224.193651:0:14397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb7a00/0xc86deac208338cb8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580224.193662:0:14397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb7a00/0xc86deac208338cb8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787580224.193687:0:14397:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787580224.193848:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb7000/0xc86deac208338cb1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d5ad expref: 19 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580224.193870:0:14397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb7a00/0xc86deac208338cb8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d5ad expref: 18 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580224.193879:0:14397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8fae5dce6000) 00010000:00010000:2.0:1787580224.193881:0:14397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787580224.193885:0:14397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae6dfb7a00, rc 0) 00000100:00100000:2.0:1787580224.194014:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7ec34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a27ab63-1899-406a-bdda-fd6b0377149d+18:14540:x1874413239786368:12345-192.168.202.36@tcp:101:cat.0 Request processed in 548us (799us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1787580224.194021:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 33 00000100:00100000:3.0:1787580224.197262:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580224.198735:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580224.199235:0:16515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239786496 00000100:00100000:0.0:1787580224.199246:0:16515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239786496 00000100:00100000:0.0:1787580224.199323:0:16515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 1 00000100:00100000:0.0:1787580224.199335:0:16515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1a27ab63-1899-406a-bdda-fd6b0377149d+18:2359:x1874413239786496:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787580224.199351:0:16515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787580224.199378:0:16515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb7a00/0xc86deac208338cb8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d5ad expref: 18 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580224.199446:0:16515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8fae5dce6000) 00010000:00010000:0.0:1787580224.199452:0:16515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787580224.199533:0:16515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1a27ab63-1899-406a-bdda-fd6b0377149d+17:2359:x1874413239786496:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 200us (2281us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580224.199561:0:16515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 1 00000100:00100000:3.0:1787580224.200015:0:14398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239786752 00000100:00100000:3.0:1787580224.200022:0:14398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239786752 00000100:00100000:3.0:1787580224.200060:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 8 00000100:00100000:3.0:1787580224.200069:0:14398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7463ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a27ab63-1899-406a-bdda-fd6b0377149d+17:14540:x1874413239786752:12345-192.168.202.36@tcp:35:cat.0 00000100:00100000:3.0:1787580224.200429:0:14398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7463ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a27ab63-1899-406a-bdda-fd6b0377149d+18:14540:x1874413239786752:12345-192.168.202.36@tcp:35:cat.0 Request processed in 360us (1703us total) trans 8589934607 rc 0/0 00000100:00100000:3.0:1787580224.200437:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 8 00000100:00100000:2.0:1787580224.271206:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580224.271327:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239787008 00000100:00100000:0.0:1787580224.271340:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239787008 00000100:00100000:0.0:1787580224.271449:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 34 00000100:00100000:0.0:1787580224.271460:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74639180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a27ab63-1899-406a-bdda-fd6b0377149d+18:14546:x1874413239787008:12345-192.168.202.36@tcp:101:dd.0 00010000:00010000:0.0:1787580224.271491:0:14395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787580224.271517:0:14395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208338cc6 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d5b4 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580224.271648:0:14395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8000/0xc86deac208338ccd lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580224.271665:0:14395:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb6400/0xc86deac208338c6b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d591 expref: 19 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580224.271674:0:14395:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150fc00/0xc86deac208338c80 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d598 expref: 19 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580224.271683:0:14395:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8000/0xc86deac208338ccd lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580224.271722:0:14395:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150fc00/0xc86deac208338c80 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d598 expref: 19 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580224.271753:0:14395:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150fc00/0xc86deac208338c80 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d598 expref: 19 pid: 14396 timeout: 672 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580224.271768:0:14395:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7ec36680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14395:1874413262843392:192.168.202.36@tcp:104: 00010000:00010000:0.0:1787580224.271892:0:14395:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb6400/0xc86deac208338c6b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d591 expref: 19 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580224.271903:0:14395:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb6400/0xc86deac208338c6b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d591 expref: 19 pid: 14397 timeout: 672 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580224.271912:0:14395:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7ec35c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14395:1874413262843520:192.168.202.36@tcp:104: 00000100:00100000:0.0:1787580224.271935:0:14395:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae5073cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1787580224.282465:0:14395:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7ec36680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14395:1874413262843392:192.168.202.36@tcp:104: 00000100:00100000:0.0:1787580224.282482:0:14395:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7ec35c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14395:1874413262843520:192.168.202.36@tcp:104: 00010000:00010000:0.0:1787580224.282520:0:14395:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8000/0xc86deac208338ccd lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580224.284508:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580224.284562:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580224.285056:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239787264 00000100:00100000:0.0:1787580224.285069:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239787264 00010000:00010000:0.0:1787580224.285124:0:14382:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb6400/0xc86deac208338c6b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d591 expref: 20 pid: 14397 timeout: 672 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580224.285170:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239787136 00000100:00100000:0.0:1787580224.285173:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239787136 00010000:00010000:0.0:1787580224.285187:0:14382:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150fc00/0xc86deac208338c80 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d598 expref: 21 pid: 14396 timeout: 672 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580224.285214:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 11 00000100:00100000:0.0:1787580224.285233:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae48e46c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1a27ab63-1899-406a-bdda-fd6b0377149d+21:2361:x1874413239787264:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787580224.285251:0:14382:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787580224.285272:0:14382:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb6400/0xc86deac208338c6b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d591 expref: 21 pid: 14397 timeout: 672 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580224.285283:0:14382:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb6400/0xc86deac208338c6b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d591 expref: 21 pid: 14397 timeout: 672 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580224.285307:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb6400/0xc86deac208338c6b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d591 expref: 21 pid: 14397 timeout: 672 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580224.285322:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8fae5dce6000) 00010000:00010000:0.0:1787580224.285328:0:14382:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8000/0xc86deac208338ccd lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580224.285337:0:14382:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8000/0xc86deac208338ccd lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580224.285344:0:14382:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787580224.285451:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae48e46c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1a27ab63-1899-406a-bdda-fd6b0377149d+20:2361:x1874413239787264:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 228us (954us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580224.285458:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 11 00000100:00100000:0.0:1787580224.285505:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 12 00000100:00100000:0.0:1787580224.285525:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7463b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1a27ab63-1899-406a-bdda-fd6b0377149d+19:2361:x1874413239787136:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787580224.285533:0:14382:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787580224.285538:0:14382:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150fc00/0xc86deac208338c80 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d598 expref: 19 pid: 14396 timeout: 672 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580224.285548:0:14382:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150fc00/0xc86deac208338c80 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d598 expref: 19 pid: 14396 timeout: 672 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580224.285571:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150fc00/0xc86deac208338c80 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d598 expref: 19 pid: 14396 timeout: 672 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580224.285582:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8fae5dce6000) 00010000:00010000:0.0:1787580224.285585:0:14382:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8000/0xc86deac208338ccd lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580224.285603:0:14382:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8000/0xc86deac208338ccd lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580224.285610:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8000/0xc86deac208338ccd lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580224.285632:0:14382:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787580224.285653:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7463b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1a27ab63-1899-406a-bdda-fd6b0377149d+18:2361:x1874413239787136:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 141us (1090us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580224.285659:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 12 00010000:00010000:0.0:1787580224.285786:0:14395:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8000/0xc86deac208338ccd lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580224.285794:0:14395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8000/0xc86deac208338ccd lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787580224.285819:0:14395:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787580224.286010:0:14395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208338cc6 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d5b4 expref: 19 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580224.286027:0:14395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8000/0xc86deac208338ccd lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d5b4 expref: 18 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580224.286049:0:14395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8fae5dce6000) 00010000:00010000:0.0:1787580224.286051:0:14395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787580224.286054:0:14395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae48db8000, rc 0) 00000100:00100000:0.0:1787580224.286087:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74639180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a27ab63-1899-406a-bdda-fd6b0377149d+18:14546:x1874413239787008:12345-192.168.202.36@tcp:101:dd.0 Request processed in 14629us (14894us total) trans 8589934608 rc 0/0 00000100:00100000:0.0:1787580224.286094:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 34 00000100:00100000:2.0:1787580224.290523:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580224.290705:0:15103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239787520 00000100:00100000:0.0:1787580224.290718:0:15103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239787520 00000100:00100000:0.0:1787580224.290799:0:15103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 35 00000100:00100000:0.0:1787580224.290811:0:15103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7463a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a27ab63-1899-406a-bdda-fd6b0377149d+18:14546:x1874413239787520:12345-192.168.202.36@tcp:36:dd.0 00010000:00010000:0.0:1787580224.291106:0:15103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208338cdb lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580224.291123:0:15103:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208338cdb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580224.291134:0:15103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208338cdb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15103 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787580224.291218:0:15103:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:0.0:1787580224.291261:0:15103:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000013b8ed6d reply state 000000006030b9d4 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208338cdb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15103 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580224.291270:0:15103:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787580224.291426:0:15103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7463a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a27ab63-1899-406a-bdda-fd6b0377149d+21:14546:x1874413239787520:12345-192.168.202.36@tcp:36:dd.0 Request processed in 574us (883us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1787580224.291435:0:15103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 35 00000020:00080000:0.0:1787580224.291449:0:15103:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787580224.298245:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208338cdb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580224.298263:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208338cdb lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580224.298272:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208338cdb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580224.298279:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db9000 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:2.0:1787580224.298299:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208338cdb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580224.298308:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208338cdb lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580224.298326:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8fae5dce6000) 00010000:00010000:2.0:1787580224.298329:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787580224.298335:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208338cdb lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580224.298341:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208338cdb lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15103 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580224.300206:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580224.301751:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239787648 00000100:00100000:1.0:1787580224.301768:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239787648 00000100:00100000:1.0:1787580224.301902:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 36 00000100:00100000:1.0:1787580224.301913:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74638a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a27ab63-1899-406a-bdda-fd6b0377149d+20:14546:x1874413239787648:12345-192.168.202.36@tcp:101:dd.0 00010000:00010000:1.0:1787580224.301953:0:14396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787580224.301975:0:14396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59e00/0xc86deac208338ce2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d5bb expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580224.302042:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59e00/0xc86deac208338ce2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d5bb expref: 21 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580224.302079:0:14396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59e00/0xc86deac208338ce2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d5bb expref: 21 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580224.302101:0:14396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8fae5dce6000) 00010000:00010000:1.0:1787580224.302104:0:14396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787580224.302108:0:14396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae4ca59e00, rc 0) 00000100:00100000:1.0:1787580224.302179:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74638a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a27ab63-1899-406a-bdda-fd6b0377149d+21:14546:x1874413239787648:12345-192.168.202.36@tcp:101:dd.0 Request processed in 267us (1983us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580224.302186:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 36 00000100:00100000:0.0:1787580224.315212:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580224.315268:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239787904 00000100:00100000:3.0:1787580224.315280:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239787904 00000100:00100000:3.0:1787580224.315367:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 2 00000100:00100000:3.0:1787580224.315378:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7ec34000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1a27ab63-1899-406a-bdda-fd6b0377149d+21:14546:x1874413239787904:12345-192.168.202.36@tcp:103:dd.0 00010000:00010000:3.0:1787580224.315433:0:14382:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787580224.315457:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59e00/0xc86deac208338ce2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d5bb expref: 21 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580224.315492:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8fae5dce6000) 00010000:00010000:3.0:1787580224.315497:0:14382:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787580224.315560:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7ec34000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1a27ab63-1899-406a-bdda-fd6b0377149d+20:14546:x1874413239787904:12345-192.168.202.36@tcp:103:dd.0 Request processed in 184us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580224.315566:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 2 00000100:00100000:3.0:1787580224.317230:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580224.317295:0:15103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239788032 00000100:00100000:0.0:1787580224.317305:0:15103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239788032 00000100:00100000:0.0:1787580224.317452:0:15103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 37 00000100:00100000:0.0:1787580224.317463:0:15103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a27ab63-1899-406a-bdda-fd6b0377149d+20:14546:x1874413239788032:12345-192.168.202.36@tcp:58:dd.0 00010000:00010000:0.0:1787580224.317754:0:15103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208338ce9 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580224.317771:0:15103:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208338ce9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580224.317782:0:15103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208338ce9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15103 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787580224.318863:0:15103:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787580224.319033:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1787580224.319105:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1787580224.319252:0:15103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a27ab63-1899-406a-bdda-fd6b0377149d+20:14546:x1874413239788032:12345-192.168.202.36@tcp:58:dd.0 Request processed in 1786us (2026us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580224.319264:0:15103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 37 00000100:00100000:3.0:1787580224.320764:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580224.321098:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239788160 00000100:00100000:2.0:1787580224.321109:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239788160 00000100:00100000:0.0:1787580224.321247:0:15103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 38 00000100:00100000:0.0:1787580224.321258:0:15103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a27ab63-1899-406a-bdda-fd6b0377149d+20:14546:x1874413239788160:12345-192.168.202.36@tcp:101:dd.0 00010000:00010000:0.0:1787580224.321280:0:15103:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787580224.321301:0:15103:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9600/0xc86deac208338cf0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d5c2 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580224.321355:0:15103:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208338ce9 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580224.321409:0:15103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9600/0xc86deac208338cf0 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d5c2 expref: 21 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580224.321429:0:15103:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208338ce9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 15103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580224.321443:0:15103:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9600/0xc86deac208338cf0 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d5c2 expref: 21 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580224.321458:0:15103:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8fae5dce6000) 00010000:00010000:0.0:1787580224.321461:0:15103:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787580224.321465:0:15103:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9600/0xc86deac208338cf0 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d5c2 expref: 21 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580224.321474:0:15103:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae48db9600, rc 0) 00000100:00100000:0.0:1787580224.321673:0:15103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a27ab63-1899-406a-bdda-fd6b0377149d+21:14546:x1874413239788160:12345-192.168.202.36@tcp:101:dd.0 Request processed in 417us (914us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580224.321682:0:15103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 38 00010000:00010000:2.0:1787580224.755749:0:15522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787580225.204184:0:14427:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787580225.204195:0:14427:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787580225.204256:0:14427:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1787580225.204263:0:14427:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1787580225.204832:0:14427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7ec35c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14427:1874413262843648:192.168.202.36@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787580225.204984:0:14427:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae5073c000 going to sleep for 11 seconds 00000100:00100000:0.0:1787580225.214983:0:14427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7ec35c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14427:1874413262843648:192.168.202.36@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787580225.216557:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580225.216681:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239788288 00000100:00100000:1.0:1787580225.216691:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239788288 00000100:00100000:1.0:1787580225.216766:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 0 00000100:00100000:1.0:1787580225.216778:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:1a27ab63-1899-406a-bdda-fd6b0377149d+21:14548:x1874413239788288:12345-192.168.202.36@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1787580225.216860:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:1a27ab63-1899-406a-bdda-fd6b0377149d+21:14548:x1874413239788288:12345-192.168.202.36@tcp:900:lhsmtool_posix.0 Request processed in 84us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580225.216868:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 0 00000100:00080000:0.0:1787580225.216943:0:14391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787580225.219843:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580225.220310:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239788416 00000100:00100000:1.0:1787580225.220323:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239788416 00000100:00100000:1.0:1787580225.220446:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 39 00000100:00100000:1.0:1787580225.220458:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74ed0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a27ab63-1899-406a-bdda-fd6b0377149d+21:14548:x1874413239788416:12345-192.168.202.36@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787580225.220506:0:14395:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787580225.220640:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74ed0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a27ab63-1899-406a-bdda-fd6b0377149d+21:14548:x1874413239788416:12345-192.168.202.36@tcp:53:lhsmtool_posix.0 Request processed in 184us (817us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580225.220649:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 39 00000100:00100000:3.0:1787580225.225132:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580225.225609:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239788544 00000100:00100000:1.0:1787580225.225624:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239788544 00000100:00100000:1.0:1787580225.225707:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 40 00000100:00100000:1.0:1787580225.225718:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74ed3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a27ab63-1899-406a-bdda-fd6b0377149d+21:14548:x1874413239788544:12345-192.168.202.36@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787580225.225803:0:14396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59400/0xc86deac208338cf7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580225.225822:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59400/0xc86deac208338cf7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580225.225834:0:14396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59400/0xc86deac208338cf7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580225.225852:0:14396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59c00/0xc86deac208338cfe lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580225.225860:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59c00/0xc86deac208338cfe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580225.225867:0:14396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59c00/0xc86deac208338cfe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580225.225892:0:14396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac208338d05 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580225.225899:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac208338d05 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580225.225902:0:14396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac208338d05 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787580225.225936:0:14396:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1787580225.225952:0:14396:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787580225.225965:0:14396:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac208338d05 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580225.225974:0:14396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59400/0xc86deac208338cf7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580225.225978:0:14396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59400/0xc86deac208338cf7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580225.225982:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59400/0xc86deac208338cf7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580225.225986:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae4ca59400 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:1.0:1787580225.225989:0:14396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59400/0xc86deac208338cf7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580225.225993:0:14396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59400/0xc86deac208338cf7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580225.226001:0:14396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8fae56e35600) 00010000:00010000:1.0:1787580225.226003:0:14396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787580225.226006:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59400/0xc86deac208338cf7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580225.226009:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59400/0xc86deac208338cf7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580225.226018:0:14396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59c00/0xc86deac208338cfe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580225.226021:0:14396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59c00/0xc86deac208338cfe lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580225.226031:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59c00/0xc86deac208338cfe lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580225.226035:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae4ca59c00 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:1.0:1787580225.226036:0:14396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59c00/0xc86deac208338cfe lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580225.226040:0:14396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59c00/0xc86deac208338cfe lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580225.226044:0:14396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff8fae5bb2f000) 00010000:00010000:1.0:1787580225.226045:0:14396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787580225.226047:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59c00/0xc86deac208338cfe lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580225.226050:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59c00/0xc86deac208338cfe lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580225.226059:0:14396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac208338d05 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580225.226062:0:14396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac208338d05 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580225.226065:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac208338d05 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580225.226067:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae4ca59200 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:1.0:1787580225.226069:0:14396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac208338d05 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580225.226089:0:14396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac208338d05 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580225.226095:0:14396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8fae5dce6000) 00010000:00010000:1.0:1787580225.226097:0:14396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787580225.226098:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac208338d05 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580225.226102:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac208338d05 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580225.226176:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74ed3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a27ab63-1899-406a-bdda-fd6b0377149d+21:14548:x1874413239788544:12345-192.168.202.36@tcp:34:lhsmtool_posix.0 Request processed in 459us (1057us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580225.226183:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 40 00000100:00100000:3.0:1787580225.238276:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580225.238447:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239788800 00000100:00100000:1.0:1787580225.238457:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239788800 00000100:00100000:1.0:1787580225.238530:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 41 00000100:00100000:1.0:1787580225.238542:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74ed0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a27ab63-1899-406a-bdda-fd6b0377149d+21:14548:x1874413239788800:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787580225.238566:0:14395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787580225.238599:0:14395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac208338d0c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d5c9 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580225.238700:0:14395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59c00/0xc86deac208338d13 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580225.238715:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59c00/0xc86deac208338d13 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580225.238726:0:14395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59c00/0xc86deac208338d13 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787580225.238752:0:14395:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787580225.238848:0:14395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59c00/0xc86deac208338d13 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580225.238855:0:14395:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59c00/0xc86deac208338d13 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580225.238862:0:14395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59c00/0xc86deac208338d13 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580225.238867:0:14395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae4ca59c00 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:1.0:1787580225.238871:0:14395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59c00/0xc86deac208338d13 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580225.238878:0:14395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59c00/0xc86deac208338d13 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580225.238890:0:14395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8fae5dce6000) 00010000:00010000:1.0:1787580225.238892:0:14395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787580225.238896:0:14395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59c00/0xc86deac208338d13 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580225.238901:0:14395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59c00/0xc86deac208338d13 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580225.238941:0:14395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac208338d0c lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d5c9 expref: 23 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580225.238950:0:14395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8fae56e35600) 00010000:00010000:1.0:1787580225.238953:0:14395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787580225.238963:0:14395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac208338d0c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d5c9 expref: 23 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580225.238972:0:14395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae4ca59200, rc 0) 00000100:00100000:1.0:1787580225.239033:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74ed0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a27ab63-1899-406a-bdda-fd6b0377149d+22:14548:x1874413239788800:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 Request processed in 494us (767us total) trans 8589934611 rc 301/301 00000100:00100000:1.0:1787580225.239040:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 41 00000100:00100000:3.0:1787580225.247993:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580225.248112:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239788928 00000100:00100000:2.0:1787580225.248124:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239788928 00000100:00100000:2.0:1787580225.248193:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 42 00000100:00100000:2.0:1787580225.248212:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74ed0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a27ab63-1899-406a-bdda-fd6b0377149d+22:14548:x1874413239788928:12345-192.168.202.36@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787580225.248271:0:14397:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787580225.248377:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74ed0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a27ab63-1899-406a-bdda-fd6b0377149d+22:14548:x1874413239788928:12345-192.168.202.36@tcp:53:lhsmtool_posix.0 Request processed in 167us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580225.249161:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 42 00000100:00100000:3.0:1787580225.257089:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580225.257830:0:15103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239789184 00000100:00100000:0.0:1787580225.257842:0:15103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239789184 00000100:00100000:0.0:1787580225.257896:0:15103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 43 00000100:00100000:0.0:1787580225.257907:0:15103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74ed2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a27ab63-1899-406a-bdda-fd6b0377149d+22:14548:x1874413239789184:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787580225.257928:0:15103:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787580225.257950:0:15103:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac208338d21 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d5d0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787580225.260159:0:15103:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x7:0x0], count =27 00000004:00080000:0.0:1787580225.260172:0:15103:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x7:0x0]+27 in llog 00000004:00080000:0.0:1787580225.260703:0:15103:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:0.0:1787580225.261021:0:15103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac208338d28 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580225.261040:0:15103:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac208338d28 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580225.261054:0:15103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac208338d28 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580225.262956:0:15103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac208338d21 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d5d0 expref: 25 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580225.262984:0:15103:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac208338d28 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d5d0 expref: 24 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580225.262994:0:15103:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8fae56e35200) 00010000:00010000:0.0:1787580225.262996:0:15103:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787580225.263000:0:15103:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae48db9e00, rc 0) 00000100:00100000:0.0:1787580225.263148:0:15103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74ed2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a27ab63-1899-406a-bdda-fd6b0377149d+24:14548:x1874413239789184:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 Request processed in 5240us (6078us total) trans 8589934612 rc 0/0 00000100:00100000:0.0:1787580225.263171:0:15103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 43 00000100:00100000:3.0:1787580225.284266:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580225.284433:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239789440 00000100:00100000:1.0:1787580225.284443:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239789440 00000100:00100000:1.0:1787580225.284514:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 44 00000100:00100000:1.0:1787580225.284524:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74ed1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a27ab63-1899-406a-bdda-fd6b0377149d+24:14548:x1874413239789440:12345-192.168.202.36@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787580225.284593:0:14396:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787580225.284622:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac208338d28 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d5d0 expref: 24 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580225.284640:0:14396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8fae56e35200) 00010000:00010000:1.0:1787580225.284651:0:14396:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787580225.284675:0:14396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac208338d36 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580225.284693:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac208338d36 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580225.284703:0:14396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac208338d36 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580225.284717:0:14396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59c00/0xc86deac208338d3d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x888188b6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580225.284724:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59c00/0xc86deac208338d3d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x888188b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580225.284757:0:14396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59c00/0xc86deac208338d3d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x888188b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580225.285018:0:14396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac208338d36 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580225.285027:0:14396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac208338d36 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580225.285034:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac208338d36 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580225.285041:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae4ca59200 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:1.0:1787580225.285046:0:14396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac208338d36 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580225.285054:0:14396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac208338d36 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580225.285064:0:14396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8fae4537f500) 00010000:00010000:1.0:1787580225.285067:0:14396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787580225.285070:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac208338d36 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580225.285076:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59200/0xc86deac208338d36 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580225.285085:0:14396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59c00/0xc86deac208338d3d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x888188b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580225.285090:0:14396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59c00/0xc86deac208338d3d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x888188b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580225.285103:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59c00/0xc86deac208338d3d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x888188b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580225.285108:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae4ca59c00 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:1.0:1787580225.285111:0:14396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59c00/0xc86deac208338d3d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x888188b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580225.285117:0:14396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59c00/0xc86deac208338d3d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x888188b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580225.285125:0:14396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x888188b6 (ffff8fae5bb2f000) 00010000:00010000:1.0:1787580225.285127:0:14396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787580225.285129:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59c00/0xc86deac208338d3d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x888188b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580225.285135:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59c00/0xc86deac208338d3d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x888188b6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580225.285360:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74ed1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a27ab63-1899-406a-bdda-fd6b0377149d+23:14548:x1874413239789440:12345-192.168.202.36@tcp:36:lhsmtool_posix.0 Request processed in 834us (1104us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787580225.285368:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 44 00000100:00100000:2.0:1787580225.289009:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580225.289553:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239789568 00000100:00100000:1.0:1787580225.289563:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239789568 00000100:00100000:1.0:1787580225.289626:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 45 00000100:00100000:1.0:1787580225.289637:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74638380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a27ab63-1899-406a-bdda-fd6b0377149d+23:14548:x1874413239789568:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787580225.289661:0:14395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787580225.289685:0:14395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59400/0xc86deac208338d44 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d5d7 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580225.289756:0:14395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59e00/0xc86deac208338d4b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580225.289771:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59e00/0xc86deac208338d4b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580225.289782:0:14395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59e00/0xc86deac208338d4b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580225.289888:0:14395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59400/0xc86deac208338d44 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d5d7 expref: 25 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580225.289929:0:14395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59e00/0xc86deac208338d4b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d5d7 expref: 24 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580225.289939:0:14395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8fae5bb2f100) 00010000:00010000:1.0:1787580225.289942:0:14395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787580225.289946:0:14395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae4ca59e00, rc 0) 00000100:00100000:1.0:1787580225.290013:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74638380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a27ab63-1899-406a-bdda-fd6b0377149d+24:14548:x1874413239789568:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 Request processed in 377us (1012us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580225.290019:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 45 00000100:00100000:3.0:1787580225.294233:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580225.295034:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239789824 00000100:00100000:1.0:1787580225.295048:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239789824 00000100:00100000:1.0:1787580225.295114:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 46 00000100:00100000:1.0:1787580225.295126:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74ed0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a27ab63-1899-406a-bdda-fd6b0377149d+24:14548:x1874413239789824:12345-192.168.202.36@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787580225.295468:0:14396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59400/0xc86deac208338d52 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580225.295497:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59400/0xc86deac208338d52 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580225.295573:0:14396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59400/0xc86deac208338d52 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787580225.296141:0:14396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:1.0:1787580225.296153:0:14396:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 573051768919ns, next at 574051765434ns, rc = 0 00000004:00010000:1.0:1787580225.297312:0:14396:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000123bf8b2 reply state 00000000d7d8ef3a transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59400/0xc86deac208338d52 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580225.297326:0:14396:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787580225.297738:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74ed0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a27ab63-1899-406a-bdda-fd6b0377149d+26:14548:x1874413239789824:12345-192.168.202.36@tcp:36:lhsmtool_posix.0 Request processed in 2599us (3500us total) trans 8589934613 rc 0/0 00000100:00100000:1.0:1787580225.297748:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 46 00000100:00100000:0.0:1787580225.302039:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00010000:00010000:3.0:1787580225.302279:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59400/0xc86deac208338d52 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580225.302294:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59400/0xc86deac208338d52 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580225.302301:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59400/0xc86deac208338d52 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580225.302308:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae4ca59400 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:3.0:1787580225.302313:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59400/0xc86deac208338d52 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580225.302339:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59400/0xc86deac208338d52 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580225.302356:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8fae5bb2f100) 00010000:00010000:3.0:1787580225.302359:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787580225.302364:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59400/0xc86deac208338d52 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580225.302370:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59400/0xc86deac208338d52 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580225.302700:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239789952 00000100:00100000:1.0:1787580225.302711:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239789952 00000100:00100000:1.0:1787580225.302811:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 47 00000100:00100000:1.0:1787580225.302824:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7ec35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a27ab63-1899-406a-bdda-fd6b0377149d+25:14548:x1874413239789952:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787580225.302854:0:14395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787580225.302874:0:14395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59c00/0xc86deac208338d59 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d5de expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580225.302938:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59c00/0xc86deac208338d59 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d5de expref: 26 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580225.302953:0:14395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59c00/0xc86deac208338d59 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d5de expref: 26 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580225.302986:0:14395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8fae5bb2f100) 00010000:00010000:1.0:1787580225.302989:0:14395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787580225.302993:0:14395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae4ca59c00, rc 0) 00000100:00100000:1.0:1787580225.303063:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7ec35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a27ab63-1899-406a-bdda-fd6b0377149d+26:14548:x1874413239789952:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 Request processed in 241us (1033us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580225.303070:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 47 00000100:00100000:2.0:1787580225.306258:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580225.306347:0:16628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239790080 00000100:00100000:0.0:1787580225.306358:0:16628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239790080 00000100:00100000:0.0:1787580225.306464:0:16628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 13 00000100:00100000:0.0:1787580225.306475:0:16628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74639f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1a27ab63-1899-406a-bdda-fd6b0377149d+5:2360:x1874413239790080:12345-192.168.202.36@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1787580225.306855:0:16628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74639f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1a27ab63-1899-406a-bdda-fd6b0377149d+6:2360:x1874413239790080:12345-192.168.202.36@tcp:2:lhsmtool_posix.0 Request processed in 380us (606us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1787580225.306863:0:16628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 13 00000100:00080000:2.0:1787580225.307223:0:14391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787580225.320692:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580225.321003:0:14398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239790336 00000100:00100000:0.0:1787580225.321014:0:14398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239790336 00000100:00100000:0.0:1787580225.321070:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 9 00000100:00100000:0.0:1787580225.321088:0:14398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74ed3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a27ab63-1899-406a-bdda-fd6b0377149d+26:14548:x1874413239790336:12345-192.168.202.36@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787580225.321357:0:14398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74ed3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a27ab63-1899-406a-bdda-fd6b0377149d+27:14548:x1874413239790336:12345-192.168.202.36@tcp:35:lhsmtool_posix.0 Request processed in 277us (676us total) trans 8589934614 rc 0/0 00000100:00100000:0.0:1787580225.321365:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 9 00000100:00100000:0.0:1787580225.324345:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580225.324500:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239790592 00000100:00100000:2.0:1787580225.324526:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239790592 00000100:00100000:2.0:1787580225.324597:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 48 00000100:00100000:2.0:1787580225.324608:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7ec36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a27ab63-1899-406a-bdda-fd6b0377149d+27:14548:x1874413239790592:12345-192.168.202.36@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787580225.324735:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7ec36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a27ab63-1899-406a-bdda-fd6b0377149d+27:14548:x1874413239790592:12345-192.168.202.36@tcp:57:lhsmtool_posix.0 Request processed in 129us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580225.324742:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 48 00000100:00100000:1.0:1787580225.335172:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580225.335520:0:15103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239790720 00000100:00100000:0.0:1787580225.335530:0:15103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239790720 00000100:00100000:0.0:1787580225.335597:0:15103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 49 00000100:00100000:0.0:1787580225.335609:0:15103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51cac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a27ab63-1899-406a-bdda-fd6b0377149d+27:14548:x1874413239790720:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787580225.335630:0:15103:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787580225.335651:0:15103:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac208338d60 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d5e5 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580225.335748:0:15103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac208338d67 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580225.335761:0:15103:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac208338d67 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580225.335770:0:15103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac208338d67 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15103 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787580225.335804:0:15103:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787580225.335822:0:15103:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac208338d67 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580225.335846:0:15103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8800/0xc86deac208338d60 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d5e5 expref: 29 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580225.335863:0:15103:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac208338d67 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d5e5 expref: 28 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580225.335871:0:15103:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8fae5bb2f100) 00010000:00010000:0.0:1787580225.335873:0:15103:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787580225.335877:0:15103:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae48db9e00, rc 0) 00000100:00100000:0.0:1787580225.335944:0:15103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51cac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a27ab63-1899-406a-bdda-fd6b0377149d+28:14548:x1874413239790720:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 Request processed in 336us (783us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580225.335951:0:15103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 49 00000100:00100000:3.0:1787580225.338726:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580225.341141:0:15078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239790848 00000100:00100000:0.0:1787580225.341158:0:15078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239790848 00000100:00100000:0.0:1787580225.341243:0:15078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 14 00000100:00100000:0.0:1787580225.341272:0:15078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74ed1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1a27ab63-1899-406a-bdda-fd6b0377149d+6:2361:x1874413239790848:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787580225.341293:0:15078:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787580225.341316:0:15078:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b84a4386/0xc86deac208338d6e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d5ec expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787580225.341345:0:15078:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8c4f41, blocks: 0x1 00010000:00010000:0.0:1787580225.341369:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=573s v=(0 0) 00010000:00010000:0.0:1787580225.341374:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787580225.341435:0:15078:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b84a4386/0xc86deac208338d6e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d5ec expref: 7 pid: 15078 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580225.341455:0:15078:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b84a4386/0xc86deac208338d6e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d5ec expref: 7 pid: 15078 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580225.341468:0:15078:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae48db9000, rc 0) 00000100:00100000:0.0:1787580225.341731:0:15078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74ed1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1a27ab63-1899-406a-bdda-fd6b0377149d+7:2361:x1874413239790848:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 Request processed in 461us (3013us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580225.341739:0:15078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 14 00000100:00100000:2.0:1787580225.346297:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580225.346560:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239791104 00000100:00100000:0.0:1787580225.346571:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239791104 00000100:00100000:0.0:1787580225.346635:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 50 00000100:00100000:0.0:1787580225.346645:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7463aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a27ab63-1899-406a-bdda-fd6b0377149d+28:14548:x1874413239791104:12345-192.168.202.36@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787580225.346778:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7463aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a27ab63-1899-406a-bdda-fd6b0377149d+28:14548:x1874413239791104:12345-192.168.202.36@tcp:57:lhsmtool_posix.0 Request processed in 134us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580225.346787:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 50 00000100:00100000:3.0:1787580225.360668:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580225.360818:0:15103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239791232 00000100:00100000:0.0:1787580225.360829:0:15103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239791232 00000100:00100000:0.0:1787580225.360899:0:15103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 51 00000100:00100000:0.0:1787580225.360911:0:15103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74ed3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a27ab63-1899-406a-bdda-fd6b0377149d+28:14548:x1874413239791232:12345-192.168.202.36@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1787580225.408881:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:3.0:1787580225.408914:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:3.0:1787580225.409054:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae74ed3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874413262843776:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787580225.409122:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580225.409772:0:15103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74ed3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a27ab63-1899-406a-bdda-fd6b0377149d+14:14548:x1874413239791232:12345-192.168.202.36@tcp:44:lhsmtool_posix.0 Request processed in 48855us (49117us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580225.409786:0:15103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 51 00000100:00100000:3.0:1787580225.409824:0:16628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262843776 00000100:00100000:3.0:1787580225.409832:0:16628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262843776 00000100:00100000:3.0:1787580225.409881:0:16628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787580225.409889:0:16628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74ed1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1874413262843776:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1787580225.410034:0:16628:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1787580225.410038:0:16628:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1787580225.410040:0:16628:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787580225.410054:0:16628:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787580225 -> 1787580225 00002000:00010000:3.0:1787580225.410057:0:16628:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1787580225.410100:0:16628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74ed1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3317:x1874413262843776:12345-0@lo:2:osp-syn-1-0.0 Request processed in 211us (978us total) trans 8589934595 rc 0/0 00000100:00100000:3.0:1787580225.410107:0:16628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:3.0:1787580225.410144:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8fae74ed3100/2, rc 0, transno 8589934595 00000100:00100000:3.0:1787580225.410151:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae74ed3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874413262843776:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787580225.414493:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580225.414774:0:15078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239791360 00000100:00100000:0.0:1787580225.414786:0:15078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239791360 00000100:00100000:0.0:1787580225.414894:0:15078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 16 00000100:00100000:0.0:1787580225.414906:0:15078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74ed2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1a27ab63-1899-406a-bdda-fd6b0377149d+7:2360:x1874413239791360:12345-192.168.202.36@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1787580225.415023:0:15078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74ed2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1a27ab63-1899-406a-bdda-fd6b0377149d+7:2360:x1874413239791360:12345-192.168.202.36@tcp:16:lhsmtool_posix.0 Request processed in 120us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580225.415031:0:15078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 16 00000100:00100000:2.0:1787580225.417789:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580225.417875:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239791616 00000100:00100000:3.0:1787580225.417884:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239791616 00000100:00100000:3.0:1787580225.417946:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 52 00000100:00100000:3.0:1787580225.417957:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74639c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a27ab63-1899-406a-bdda-fd6b0377149d+14:14548:x1874413239791616:12345-192.168.202.36@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787580225.418013:0:14397:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787580225.418037:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9e00/0xc86deac208338d67 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d5e5 expref: 14 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580225.418056:0:14397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8fae5bb2f100) 00010000:00010000:3.0:1787580225.418061:0:14397:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787580225.418089:0:14397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150e400/0xc86deac208338d75 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580225.418103:0:14397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150e400/0xc86deac208338d75 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580225.418112:0:14397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150e400/0xc86deac208338d75 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787580225.418488:0:14397:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000001695756 reply state 000000004f816e73 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150e400/0xc86deac208338d75 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580225.418652:0:14397:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787580225.418799:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74639c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a27ab63-1899-406a-bdda-fd6b0377149d+15:14548:x1874413239791616:12345-192.168.202.36@tcp:36:lhsmtool_posix.0 Request processed in 843us (1018us total) trans 8589934615 rc 0/0 00000100:00100000:3.0:1787580225.418807:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 52 00010000:00010000:2.0:1787580225.421909:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150e400/0xc86deac208338d75 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580225.421926:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150e400/0xc86deac208338d75 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580225.421933:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150e400/0xc86deac208338d75 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580225.421940:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae4150e400 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:2.0:1787580225.421945:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150e400/0xc86deac208338d75 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580225.421953:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150e400/0xc86deac208338d75 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580225.421970:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8fae5bb2f100) 00010000:00010000:2.0:1787580225.421973:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787580225.421978:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150e400/0xc86deac208338d75 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580225.421984:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150e400/0xc86deac208338d75 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580225.422442:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580225.422846:0:16628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239791744 00000100:00100000:0.0:1787580225.422857:0:16628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239791744 00000100:00100000:0.0:1787580225.422919:0:16628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 17 00000100:00100000:0.0:1787580225.422928:0:16628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7463bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1a27ab63-1899-406a-bdda-fd6b0377149d+7:14548:x1874413239791744:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787580225.422945:0:16628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787580225.422962:0:16628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000023d07362/0xc86deac208338d7c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf454739e86a9d5f3 expref: -99 pid: 16628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580225.422990:0:16628:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b84a4386/0xc86deac208338d6e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d5ec expref: 8 pid: 15078 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580225.422997:0:16628:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787580225.423001:0:16628:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787580225.423005:0:16628:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000023d07362/0xc86deac208338d7c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d5f3 expref: 8 pid: 16628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580225.423055:0:16628:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b84a4386/0xc86deac208338d6e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d5ec expref: 8 pid: 15078 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580225.423069:0:16628:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b84a4386/0xc86deac208338d6e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d5ec expref: 8 pid: 15078 timeout: 673 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580225.423084:0:16628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7ec34700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:16628:1874413262843904:192.168.202.36@tcp:104: 00000100:00100000:0.0:1787580225.423171:0:16628:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae452c9d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787580225.425898:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580225.426014:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239791872 00000100:00100000:1.0:1787580225.426024:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239791872 00010000:00010000:1.0:1787580225.426077:0:14380:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b84a4386/0xc86deac208338d6e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d5ec expref: 9 pid: 15078 timeout: 673 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580225.426119:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 13 00000100:00100000:1.0:1787580225.426128:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74ed1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1a27ab63-1899-406a-bdda-fd6b0377149d+9:2360:x1874413239791872:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787580225.426144:0:14380:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787580225.426167:0:14380:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b84a4386/0xc86deac208338d6e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d5ec expref: 9 pid: 15078 timeout: 673 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580225.426182:0:14380:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b84a4386/0xc86deac208338d6e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d5ec expref: 9 pid: 15078 timeout: 673 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580225.426221:0:14380:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787580225.426226:0:14380:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787580225.426232:0:14380:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000023d07362/0xc86deac208338d7c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d5f3 expref: 9 pid: 16628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580225.426262:0:14380:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000023d07362/0xc86deac208338d7c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d5f3 expref: 9 pid: 16628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580225.426300:0:14380:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000023d07362/0xc86deac208338d7c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d5f3 expref: 9 pid: 16628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580225.426315:0:14380:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae51caf100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:14380:1874413262844032:192.168.202.36@tcp:105: 00010000:00010000:0.0:1787580225.426512:0:16628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b84a4386/0xc86deac208338d6e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d5ec expref: 9 pid: 15078 timeout: 673 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580225.426529:0:16628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7ec34700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:16628:1874413262843904:192.168.202.36@tcp:104: 00010000:00010000:0.0:1787580225.426554:0:16628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000023d07362/0xc86deac208338d7c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d5f3 expref: 8 pid: 16628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580225.426565:0:16628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8fae48db8200, rc 0) 00000100:00100000:1.0:1787580225.427637:0:14380:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fad43647a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787580225.427724:0:16628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7463bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1a27ab63-1899-406a-bdda-fd6b0377149d+8:14548:x1874413239791744:12345-192.168.202.36@tcp:101:lhsmtool_posix.0 Request processed in 4794us (5282us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580225.427745:0:16628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 17 00000100:00100000:3.0:1787580225.431665:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580225.431985:0:14380:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae51caf100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:14380:1874413262844032:192.168.202.36@tcp:105: 00010000:00010000:2.0:1787580225.432010:0:14380:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787580225.432064:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74ed1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1a27ab63-1899-406a-bdda-fd6b0377149d+7:2360:x1874413239791872:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 5936us (6174us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580225.432076:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 13 00000100:00100000:0.0:1787580225.432164:0:15080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239792000 00000100:00100000:0.0:1787580225.432173:0:15080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239792000 00000100:00100000:0.0:1787580225.432237:0:15080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 18 00000100:00100000:0.0:1787580225.432246:0:15080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74ed1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1a27ab63-1899-406a-bdda-fd6b0377149d+7:2361:x1874413239792000:12345-192.168.202.36@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787580225.432495:0:15080:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1787580225.432510:0:15080:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1787580224 00002000:00010000:0.0:1787580225.432513:0:15080:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1787580223 00002000:00010000:0.0:1787580225.432515:0:15080:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787580225 -> 1787580224 00002000:00010000:0.0:1787580225.432517:0:15080:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1787580225.432545:0:15080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74ed1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1a27ab63-1899-406a-bdda-fd6b0377149d+8:2361:x1874413239792000:12345-192.168.202.36@tcp:2:lhsmtool_posix.0 Request processed in 299us (892us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1787580225.432553:0:15080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 18 00000100:00100000:2.0:1787580225.435909:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580225.436686:0:15079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239792128 00000100:00100000:3.0:1787580225.436697:0:15079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239792128 00000100:00100000:2.0:1787580225.436850:0:15079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 19 00000100:00100000:2.0:1787580225.436860:0:15079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74638700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1a27ab63-1899-406a-bdda-fd6b0377149d+8:2358:x1874413239792128:12345-192.168.202.36@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787580225.436901:0:15079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000007b35f279/0xc86deac208338d83 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580225.436920:0:15079:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000023d07362/0xc86deac208338d7c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d5f3 expref: 8 pid: 16628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580225.436929:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787580225.436933:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787580225.436938:0:15079:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007b35f279/0xc86deac208338d83 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580225.436971:0:15079:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000023d07362/0xc86deac208338d7c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d5f3 expref: 8 pid: 16628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580225.436984:0:15079:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000023d07362/0xc86deac208338d7c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d5f3 expref: 8 pid: 16628 timeout: 673 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580225.437013:0:15079:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae74639880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:15079:1874413262844160:192.168.202.36@tcp:104: 00000100:00100000:2.0:1787580225.437123:0:15079:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae779f3a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787580225.443126:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580225.443222:0:15079:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae74639880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:15079:1874413262844160:192.168.202.36@tcp:104: 00010000:00010000:3.0:1787580225.443251:0:15079:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007b35f279/0xc86deac208338d83 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580225.443892:0:16515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239792256 00000100:00100000:0.0:1787580225.443904:0:16515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239792256 00010000:00010000:0.0:1787580225.443948:0:16515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000023d07362/0xc86deac208338d7c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d5f3 expref: 9 pid: 16628 timeout: 673 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580225.443989:0:16515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 14 00000100:00100000:0.0:1787580225.443998:0:16515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74638000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1a27ab63-1899-406a-bdda-fd6b0377149d+9:2360:x1874413239792256:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787580225.444014:0:16515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787580225.444039:0:16515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000023d07362/0xc86deac208338d7c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d5f3 expref: 9 pid: 16628 timeout: 673 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580225.444052:0:16515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000023d07362/0xc86deac208338d7c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d5f3 expref: 9 pid: 16628 timeout: 673 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580225.444075:0:16515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000023d07362/0xc86deac208338d7c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d5f3 expref: 9 pid: 16628 timeout: 673 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580225.444110:0:16515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787580225.444115:0:16515:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787580225.444121:0:16515:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007b35f279/0xc86deac208338d83 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580225.444131:0:16515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007b35f279/0xc86deac208338d83 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580225.444161:0:16515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787580225.449655:0:16515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74638000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1a27ab63-1899-406a-bdda-fd6b0377149d+8:2360:x1874413239792256:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 5643us (6526us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580225.449672:0:16515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 14 00010000:00010000:0.0:1787580225.449735:0:15079:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007b35f279/0xc86deac208338d83 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580225.449749:0:15079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007b35f279/0xc86deac208338d83 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580225.449785:0:15079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000007b35f279/0xc86deac208338d83 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580225.449794:0:15079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007b35f279/0xc86deac208338d83 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580225.449801:0:15079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007b35f279/0xc86deac208338d83 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580225.449826:0:15079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae6dfb7000 already unused, calling callback (ffffffffc155a230) 00010000:00010000:0.0:1787580225.449831:0:15079:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007b35f279/0xc86deac208338d83 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580225.449839:0:15079:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007b35f279/0xc86deac208338d83 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580225.449859:0:15079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007b35f279/0xc86deac208338d83 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580225.449868:0:15079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007b35f279/0xc86deac208338d83 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580225.451826:0:15079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74638700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1a27ab63-1899-406a-bdda-fd6b0377149d+7:2358:x1874413239792128:12345-192.168.202.36@tcp:1:lhsmtool_posix.0 Request processed in 14958us (15917us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580225.451839:0:15079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 19 00000100:00100000:1.0:1787580225.453968:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580225.454052:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239792512 00000100:00100000:0.0:1787580225.454062:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239792512 00000100:00100000:0.0:1787580225.454126:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 53 00000100:00100000:0.0:1787580225.454139:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51cae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a27ab63-1899-406a-bdda-fd6b0377149d+14:14548:x1874413239792512:12345-192.168.202.36@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787580225.454243:0:14395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208338d8a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580225.454262:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208338d8a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580225.454294:0:14395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208338d8a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580225.454608:0:14395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8600/0xc86deac208338d91 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580225.454619:0:14395:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59c00/0xc86deac208338d59 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d5de expref: 15 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580225.454627:0:14395:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8600/0xc86deac208338d91 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580225.454661:0:14395:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59c00/0xc86deac208338d59 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d5de expref: 15 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580225.454677:0:14395:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59c00/0xc86deac208338d59 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d5de expref: 15 pid: 14395 timeout: 673 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580225.454691:0:14395:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7ec34700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14395:1874413262844288:192.168.202.36@tcp:104: 00000100:00100000:0.0:1787580225.454769:0:14395:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae452c9d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787580225.458493:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580225.458660:0:14395:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7ec34700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14395:1874413262844288:192.168.202.36@tcp:104: 00010000:00010000:1.0:1787580225.458690:0:14395:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8600/0xc86deac208338d91 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580225.458920:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239792640 00000100:00100000:3.0:1787580225.458927:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239792640 00010000:00010000:3.0:1787580225.458965:0:14381:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59c00/0xc86deac208338d59 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d5de expref: 16 pid: 14395 timeout: 673 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580225.459005:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 15 00000100:00100000:3.0:1787580225.459016:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5ff1c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1a27ab63-1899-406a-bdda-fd6b0377149d+16:2361:x1874413239792640:12345-192.168.202.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787580225.459031:0:14381:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787580225.459038:0:14381:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59c00/0xc86deac208338d59 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d5de expref: 16 pid: 14395 timeout: 673 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580225.459049:0:14381:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59c00/0xc86deac208338d59 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d5de expref: 16 pid: 14395 timeout: 673 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580225.459093:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4ca59c00/0xc86deac208338d59 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d5de expref: 16 pid: 14395 timeout: 673 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580225.459111:0:14381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8fae5bb2f100) 00010000:00010000:3.0:1787580225.459117:0:14381:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8600/0xc86deac208338d91 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580225.459129:0:14381:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8600/0xc86deac208338d91 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580225.459137:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8600/0xc86deac208338d91 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580225.459165:0:14381:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787580225.459345:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5ff1c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1a27ab63-1899-406a-bdda-fd6b0377149d+15:2361:x1874413239792640:12345-192.168.202.36@tcp:103:ldlm_bl.0 Request processed in 330us (862us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580225.459354:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 15 00010000:00010000:0.0:1787580225.460439:0:14395:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8600/0xc86deac208338d91 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580225.460452:0:14395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8600/0xc86deac208338d91 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787580225.460694:0:14395:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:0.0:1787580225.460869:0:14395:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:0.0:1787580225.460938:0:14395:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:0.0:1787580225.461020:0:14395:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5ff1c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14395:1874413262844416:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787580225.461082:0:14395:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787580225.461120:0:14395:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae452c9540 going to sleep for 11 seconds 00000100:00100000:1.0:1787580225.461694:0:14400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262844416 00000100:00100000:1.0:1787580225.461704:0:14400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262844416 00000100:00100000:1.0:1787580225.461764:0:14400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787580225.461777:0:14400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae5ff1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14395:x1874413262844416:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787580225.461873:0:14400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae5ff1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14395:x1874413262844416:12345-0@lo:1000:mdt00_000.0 Request processed in 99us (790us total) trans 0 rc 0/0 00000100:00100000:1.0:1787580225.461881:0:14400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787580225.462021:0:14395:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5ff1c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14395:1874413262844416:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1787580225.462953:0:14395:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:3.0:1787580225.463032:0:14395:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae74ed2680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14395:1874413262844544:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787580225.463081:0:14395:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580225.463105:0:14395:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae5061b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787580225.463132:0:14400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262844544 00000100:00100000:3.0:1787580225.463138:0:14400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262844544 00000100:00100000:3.0:1787580225.463168:0:14400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787580225.463175:0:14400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74ed2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14395:x1874413262844544:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787580225.465539:0:14400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74ed2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14395:x1874413262844544:12345-0@lo:1000:mdt00_000.0 Request processed in 2356us (2449us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1787580225.465557:0:14400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787580225.466159:0:14395:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae74ed2680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14395:1874413262844544:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1787580225.466291:0:14395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8600/0xc86deac208338d91 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580225.466303:0:14395:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8600/0xc86deac208338d91 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580225.466311:0:14395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8600/0xc86deac208338d91 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580225.466317:0:14395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db8600 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:3.0:1787580225.466323:0:14395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8600/0xc86deac208338d91 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580225.466331:0:14395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8600/0xc86deac208338d91 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580225.466348:0:14395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8fae5bb2f100) 00010000:00010000:3.0:1787580225.466352:0:14395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787580225.466357:0:14395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8600/0xc86deac208338d91 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580225.466362:0:14395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db8600/0xc86deac208338d91 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580225.466994:0:14395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208338ce9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 15103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580225.467004:0:14395:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208338ce9 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 15103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580225.467010:0:14395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208338ce9 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 15103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580225.467027:0:14395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db9c00 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:3.0:1787580225.467030:0:14395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208338ce9 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 15103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580225.467036:0:14395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208338ce9 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 15103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580225.467046:0:14395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8fae5dce6000) 00010000:00010000:3.0:1787580225.467049:0:14395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787580225.467056:0:14395:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9600/0xc86deac208338cf0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d5c2 expref: 18 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580225.467068:0:14395:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9600/0xc86deac208338cf0 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d5c2 expref: 18 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580225.467077:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9600/0xc86deac208338cf0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d5c2 expref: 18 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580225.467293:0:14395:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9600/0xc86deac208338cf0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.36@tcp remote: 0xf454739e86a9d5c2 expref: 18 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580225.467310:0:14395:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae74639880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14395:1874413262844672:192.168.202.36@tcp:105: 00000100:00100000:2.0:1787580225.467623:0:14395:0:(client.c:2715:ptlrpc_set_wait()) set ffff8fae779f3540 going to sleep for 11 seconds 00000100:00100000:0.0:1787580225.471140:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580225.471207:0:14398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239792768 00000100:00100000:3.0:1787580225.471216:0:14398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239792768 00000100:00100000:3.0:1787580225.471273:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 10 00000100:00100000:3.0:1787580225.471284:0:14398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae6d757450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a27ab63-1899-406a-bdda-fd6b0377149d+19:14546:x1874413239792768:12345-192.168.202.36@tcp:49:dd.0 00000100:00100000:3.0:1787580225.471438:0:14398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae6d757450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a27ab63-1899-406a-bdda-fd6b0377149d+19:14546:x1874413239792768:12345-192.168.202.36@tcp:49:dd.0 Request processed in 156us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580225.471446:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 10 00000100:00100000:2.0:1787580225.476560:0:14395:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae74639880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14395:1874413262844672:192.168.202.36@tcp:105: 00010000:00010000:2.0:1787580225.476604:0:14395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208338ce9 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 15103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580225.476615:0:14395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9c00/0xc86deac208338ce9 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 15103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580225.476654:0:14395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb6400/0xc86deac208338d98 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580225.476667:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb6400/0xc86deac208338d98 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580225.476679:0:14395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb6400/0xc86deac208338d98 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580225.476709:0:14395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb6400/0xc86deac208338d98 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580225.476715:0:14395:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb6400/0xc86deac208338d98 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580225.476721:0:14395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb6400/0xc86deac208338d98 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580225.476728:0:14395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae6dfb6400 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:2.0:1787580225.476732:0:14395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb6400/0xc86deac208338d98 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580225.476740:0:14395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb6400/0xc86deac208338d98 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580225.476755:0:14395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8fae5dce6000) 00010000:00010000:2.0:1787580225.476758:0:14395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787580225.476762:0:14395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb6400/0xc86deac208338d98 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580225.476767:0:14395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae6dfb6400/0xc86deac208338d98 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580225.476776:0:14395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208338d8a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580225.476781:0:14395:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208338d8a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580225.476786:0:14395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208338d8a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580225.476796:0:14395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db9000 already unused, calling callback (ffffffffc1f994f0) 00010000:00010000:2.0:1787580225.476799:0:14395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208338d8a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580225.476805:0:14395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208338d8a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580225.476814:0:14395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8fae5dce6000) 00010000:00010000:2.0:1787580225.476816:0:14395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787580225.476818:0:14395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208338d8a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580225.476823:0:14395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae48db9000/0xc86deac208338d8a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580225.478136:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51cae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a27ab63-1899-406a-bdda-fd6b0377149d+18:14548:x1874413239792512:12345-192.168.202.36@tcp:57:lhsmtool_posix.0 Request processed in 23994us (24172us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1787580225.478149:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 53 00000020:00080000:2.0:1787580225.478155:0:14395:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1787580225.482491:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580225.482764:0:14398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239793024 00000100:00100000:3.0:1787580225.482775:0:14398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239793024 00000100:00100000:3.0:1787580225.482844:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 11 00000100:00100000:3.0:1787580225.482853:0:14398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51caca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a27ab63-1899-406a-bdda-fd6b0377149d+18:14548:x1874413239793024:12345-192.168.202.36@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787580225.483838:0:14398:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787580225.483939:0:14398:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:3.0:1787580225.483988:0:14398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150fc00/0xc86deac208338d9f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580225.484005:0:14398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150fc00/0xc86deac208338d9f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580225.484016:0:14398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150fc00/0xc86deac208338d9f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580225.484025:0:14398:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150fc00/0xc86deac208338d9f lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580225.484030:0:14398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150fc00/0xc86deac208338d9f lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580225.484037:0:14398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150fc00/0xc86deac208338d9f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580225.484093:0:14398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787580225.484190:0:14398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51caca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a27ab63-1899-406a-bdda-fd6b0377149d+20:14548:x1874413239793024:12345-192.168.202.36@tcp:35:lhsmtool_posix.0 Request processed in 1336us (1709us total) trans 8589934622 rc 0/0 00000100:00100000:3.0:1787580225.484210:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 11 00000020:00080000:3.0:1787580225.484215:0:14398:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:0.0:1787580225.488044:0:14427:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787580225.488054:0:14427:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787580225.488084:0:14427:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1787580225.488090:0:14427:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1787580225.489605:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787580225.489617:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150fc00/0xc86deac208338d9f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580225.489628:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae4150fc00 already unused, calling callback (ffffffffc155a230) 00010000:00010000:2.0:1787580225.489632:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150fc00/0xc86deac208338d9f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580225.489642:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150fc00/0xc86deac208338d9f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580225.489682:0:14384:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8fae5bb2f100) 00010000:00010000:2.0:1787580225.489685:0:14384:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787580225.489690:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150fc00/0xc86deac208338d9f lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580225.489696:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8fae4150fc00/0xc86deac208338d9f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580225.489793:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787580225.489796:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787580225.489798:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787580225.658850:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580225.658895:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580225.658924:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:1.0:1787580225.658979:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:0.0:1787580225.659233:0:15086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239793152 00000100:00100000:0.0:1787580225.659242:0:15086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239793152 00000100:00100000:0.0:1787580225.659297:0:15086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239793280 00000100:00100000:0.0:1787580225.659305:0:15086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239793280 00000100:00100000:0.0:1787580225.659320:0:15086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239793408 00000100:00100000:0.0:1787580225.659323:0:15086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239793408 00000100:00100000:0.0:1787580225.659333:0:15086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239793536 00000100:00100000:0.0:1787580225.659336:0:15086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239793536 00000100:00100000:0.0:1787580225.659352:0:15086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 0 00000100:00100000:0.0:1787580225.659363:0:15086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51cadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1a27ab63-1899-406a-bdda-fd6b0377149d+10:2360:x1874413239793152:12345-192.168.202.36@tcp:4:dd.0 00002000:00010000:0.0:1787580225.659456:0:15086:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a8c4f40, atime: 0x6a8c4f3f, ctime: 0x6a8c4f40, blocks: 0x1 00010000:00010000:0.0:1787580225.659465:0:15086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023d07362/0xc86deac208338da6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580225.659488:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=573s v=(0 0) 00010000:00010000:0.0:1787580225.659492:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787580225.659508:0:15086:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000023d07362/0xc86deac208338da6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580225.659531:0:15086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000023d07362/0xc86deac208338da6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580225.663091:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580225.663235:0:15085:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1787580225.663246:0:15085:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:3.0:1787580225.663757:0:15085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239793664 00000100:00100000:3.0:1787580225.663771:0:15085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239793664 00000100:00100000:2.0:1787580225.664313:0:16629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 1 00000100:00100000:2.0:1787580225.664328:0:16629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51cac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1a27ab63-1899-406a-bdda-fd6b0377149d+12:2361:x1874413239793280:12345-192.168.202.36@tcp:4:dd.0 00010000:00010000:2.0:1787580225.664365:0:16629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4a852db/0xc86deac208338dad lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580225.664429:0:16629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787580225.664434:0:16629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787580225.664441:0:16629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4a852db/0xc86deac208338dad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580225.664454:0:16629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c4a852db/0xc86deac208338dad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580225.679940:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580225.680117:0:15085:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1787580225.680128:0:15085:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:2.0:1787580225.680341:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580225.680417:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580225.683327:0:15084:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1787580225.683349:0:15084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239793792 00000100:00100000:3.0:1787580225.683358:0:15084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239793792 00000100:00100000:3.0:1787580225.683436:0:15084:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1787580225.683442:0:15084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239793920 00000100:00100000:3.0:1787580225.683445:0:15084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239793920 00000100:00100000:3.0:1787580225.683459:0:15084:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1787580225.683464:0:15084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239794048 00000100:00100000:3.0:1787580225.683467:0:15084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239794048 00000100:00100000:0.0:1787580225.686830:0:16630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 2 00000100:00100000:0.0:1787580225.686848:0:16630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51caf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1a27ab63-1899-406a-bdda-fd6b0377149d+16:2361:x1874413239793408:12345-192.168.202.36@tcp:4:dd.0 00010000:00010000:0.0:1787580225.686889:0:16630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b84a4386/0xc86deac208338db4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580225.686906:0:16630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787580225.686910:0:16630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787580225.686917:0:16630:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b84a4386/0xc86deac208338db4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580225.686931:0:16630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b84a4386/0xc86deac208338db4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787580225.783800:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934596 is committed 00000001:00080000:3.0:1787580225.783825:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00000001:00080000:3.0:1787580225.783834:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00010000:00010000:3.0:1787580225.783852:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787580225.783959:0:15086:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 3145728 00002000:00010000:2.0:1787580225.783971:0:15086:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1787580224 -> 1787580225 00002000:00010000:2.0:1787580225.783973:0:15086:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787580224 -> 1787580225 00002000:00010000:2.0:1787580225.783976:0:15086:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 6151 00010000:00010000:2.0:1787580225.783990:0:15086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023d07362/0xc86deac208338da6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580225.784002:0:15086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000023d07362/0xc86deac208338da6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580225.784011:0:15086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000023d07362/0xc86deac208338da6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580225.784018:0:15086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db8200 already unused, calling callback (ffffffffc155a230) 00010000:00010000:2.0:1787580225.784023:0:15086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000023d07362/0xc86deac208338da6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580225.784032:0:15086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000023d07362/0xc86deac208338da6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580225.784052:0:15086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000023d07362/0xc86deac208338da6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580225.784060:0:15086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000023d07362/0xc86deac208338da6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580225.784168:0:15086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51cadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1a27ab63-1899-406a-bdda-fd6b0377149d+18:2360:x1874413239793152:12345-192.168.202.36@tcp:4:dd.0 Request processed in 124802us (125323us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1787580225.784178:0:15086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 0 00000100:00100000:2.0:1787580225.784221:0:15086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 3 00000100:00100000:2.0:1787580225.784233:0:15086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51cad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1a27ab63-1899-406a-bdda-fd6b0377149d+17:2360:x1874413239793536:12345-192.168.202.36@tcp:4:dd.0 00010000:00010000:2.0:1787580225.784263:0:15086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037a5d1d5/0xc86deac208338dbb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580225.784275:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787580225.784279:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787580225.784287:0:15086:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000037a5d1d5/0xc86deac208338dbb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580225.784300:0:15086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000037a5d1d5/0xc86deac208338dbb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787580225.832518:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00002000:00010000:2.0:1787580225.833194:0:16630:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 3145728 -> 4194304 00010000:00010000:2.0:1787580225.833212:0:16630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b84a4386/0xc86deac208338db4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580225.833225:0:16630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b84a4386/0xc86deac208338db4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580225.833234:0:16630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b84a4386/0xc86deac208338db4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580225.833240:0:16630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db9000 already unused, calling callback (ffffffffc155a230) 00010000:00010000:2.0:1787580225.833246:0:16630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b84a4386/0xc86deac208338db4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580225.833271:0:16630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b84a4386/0xc86deac208338db4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580225.833291:0:16630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b84a4386/0xc86deac208338db4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580225.833299:0:16630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b84a4386/0xc86deac208338db4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580225.833707:0:16629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4a852db/0xc86deac208338dad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580225.833719:0:16629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c4a852db/0xc86deac208338dad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580225.833726:0:16629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c4a852db/0xc86deac208338dad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580225.833732:0:16629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae6dfb6400 already unused, calling callback (ffffffffc155a230) 00010000:00010000:3.0:1787580225.833736:0:16629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4a852db/0xc86deac208338dad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580225.833744:0:16629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4a852db/0xc86deac208338dad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580225.833756:0:16629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c4a852db/0xc86deac208338dad lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580225.833773:0:16629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c4a852db/0xc86deac208338dad lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580225.833817:0:16629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51cac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1a27ab63-1899-406a-bdda-fd6b0377149d+14:2361:x1874413239793280:12345-192.168.202.36@tcp:4:dd.0 Request processed in 169487us (174916us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1787580225.833827:0:16629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 1 00000100:00100000:3.0:1787580225.833864:0:16629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 4 00000100:00100000:3.0:1787580225.833875:0:16629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae51cafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1a27ab63-1899-406a-bdda-fd6b0377149d+13:2360:x1874413239793664:12345-192.168.202.36@tcp:4:dd.0 00010000:00010000:3.0:1787580225.833909:0:16629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b8b516d/0xc86deac208338dc2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580225.833920:0:16629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787580225.833925:0:16629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787580225.833930:0:16629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b8b516d/0xc86deac208338dc2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580225.833940:0:16629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b8b516d/0xc86deac208338dc2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787580225.834089:0:16630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51caf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1a27ab63-1899-406a-bdda-fd6b0377149d+14:2361:x1874413239793408:12345-192.168.202.36@tcp:4:dd.0 Request processed in 147244us (175161us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1787580225.834097:0:16630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 2 00000100:00100000:2.0:1787580225.834115:0:16630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 5 00000100:00100000:2.0:1787580225.834123:0:16630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74639880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1a27ab63-1899-406a-bdda-fd6b0377149d+13:2361:x1874413239793792:12345-192.168.202.36@tcp:4:dd.0 00010000:00010000:2.0:1787580225.834140:0:16630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004136fa00/0xc86deac208338dc9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580225.834148:0:16630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787580225.834151:0:16630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787580225.834156:0:16630:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004136fa00/0xc86deac208338dc9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787580225.834164:0:16630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004136fa00/0xc86deac208338dc9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787580225.902877:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934601 is committed 00002000:00010000:0.0:1787580225.902953:0:15086:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 4194304 -> 5242880 00002000:00010000:0.0:1787580225.902957:0:15086:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:0.0:1787580225.902974:0:15086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037a5d1d5/0xc86deac208338dbb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580225.902988:0:15086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000037a5d1d5/0xc86deac208338dbb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580225.903015:0:15086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000037a5d1d5/0xc86deac208338dbb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580225.903023:0:15086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae6dfb7a00 already unused, calling callback (ffffffffc155a230) 00010000:00010000:0.0:1787580225.903030:0:15086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000037a5d1d5/0xc86deac208338dbb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580225.903039:0:15086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000037a5d1d5/0xc86deac208338dbb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580225.903062:0:15086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000037a5d1d5/0xc86deac208338dbb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580225.903070:0:15086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000037a5d1d5/0xc86deac208338dbb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580225.906166:0:15086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51cad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1a27ab63-1899-406a-bdda-fd6b0377149d+13:2360:x1874413239793536:12345-192.168.202.36@tcp:4:dd.0 Request processed in 121917us (247166us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1787580225.906183:0:15086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 3 00000100:00100000:0.0:1787580225.906234:0:15086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 6 00000100:00100000:0.0:1787580225.906252:0:15086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7463a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1a27ab63-1899-406a-bdda-fd6b0377149d+12:2361:x1874413239793920:12345-192.168.202.36@tcp:4:dd.0 00010000:00010000:0.0:1787580225.906297:0:15086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fbc6d3f5/0xc86deac208338dd0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580225.906315:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787580225.906337:0:15086:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787580225.906345:0:15086:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fbc6d3f5/0xc86deac208338dd0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580225.906362:0:15086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fbc6d3f5/0xc86deac208338dd0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787580225.981134:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934602 is committed 00002000:00010000:0.0:1787580225.991314:0:16629:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 5242880 -> 7340032 00002000:00010000:0.0:1787580225.991325:0:16629:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 14343 00010000:00010000:0.0:1787580225.991341:0:16629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b8b516d/0xc86deac208338dc2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580225.991355:0:16629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006b8b516d/0xc86deac208338dc2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580225.991364:0:16629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006b8b516d/0xc86deac208338dc2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580225.991370:0:16629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae4150ee00 already unused, calling callback (ffffffffc155a230) 00010000:00010000:0.0:1787580225.991375:0:16629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006b8b516d/0xc86deac208338dc2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580225.991410:0:16629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006b8b516d/0xc86deac208338dc2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580225.991432:0:16629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006b8b516d/0xc86deac208338dc2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580225.991462:0:16629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b8b516d/0xc86deac208338dc2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787580225.991566:0:16629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae51cafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1a27ab63-1899-406a-bdda-fd6b0377149d+14:2360:x1874413239793664:12345-192.168.202.36@tcp:4:dd.0 Request processed in 157689us (328490us total) trans 8589934602 rc 0/0 00000100:00100000:0.0:1787580225.991585:0:16629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 4 00000100:00100000:0.0:1787580225.991621:0:16629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 7 00000100:00100000:0.0:1787580225.991635:0:16629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7463ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1a27ab63-1899-406a-bdda-fd6b0377149d+13:2360:x1874413239794048:12345-192.168.202.36@tcp:4:dd.0 00010000:00010000:0.0:1787580225.991670:0:16629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6b004f7/0xc86deac208338dd7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580225.991681:0:16629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787580225.991685:0:16629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787580225.991691:0:16629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6b004f7/0xc86deac208338dd7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787580225.991702:0:16629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d6b004f7/0xc86deac208338dd7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787580226.053631:0:15086:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00010000:00010000:1.0:1787580226.053651:0:15086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fbc6d3f5/0xc86deac208338dd0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580226.053665:0:15086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fbc6d3f5/0xc86deac208338dd0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580226.053674:0:15086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fbc6d3f5/0xc86deac208338dd0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580226.053681:0:15086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db9e00 already unused, calling callback (ffffffffc155a230) 00010000:00010000:1.0:1787580226.053686:0:15086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fbc6d3f5/0xc86deac208338dd0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580226.053695:0:15086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fbc6d3f5/0xc86deac208338dd0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580226.053716:0:15086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fbc6d3f5/0xc86deac208338dd0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580226.053723:0:15086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fbc6d3f5/0xc86deac208338dd0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580226.055005:0:15086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7463a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1a27ab63-1899-406a-bdda-fd6b0377149d+15:2361:x1874413239793920:12345-192.168.202.36@tcp:4:dd.0 Request processed in 148754us (374657us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1787580226.055042:0:15086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 6 00000001:00080000:2.0:1787580226.059725:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934604 is committed 00002000:00010000:1.0:1787580226.066480:0:16630:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:1.0:1787580226.066515:0:16630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004136fa00/0xc86deac208338dc9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580226.066528:0:16630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004136fa00/0xc86deac208338dc9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580226.066537:0:16630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004136fa00/0xc86deac208338dc9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580226.066545:0:16630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae6dfb7400 already unused, calling callback (ffffffffc155a230) 00010000:00010000:1.0:1787580226.066550:0:16630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004136fa00/0xc86deac208338dc9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580226.066559:0:16630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004136fa00/0xc86deac208338dc9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580226.066590:0:16630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004136fa00/0xc86deac208338dc9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787580226.066598:0:16630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004136fa00/0xc86deac208338dc9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787580226.066702:0:16630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74639880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1a27ab63-1899-406a-bdda-fd6b0377149d+9:2361:x1874413239793792:12345-192.168.202.36@tcp:4:dd.0 Request processed in 232574us (386768us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1787580226.066728:0:16630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 5 00000001:00080000:2.0:1787580226.138490:0:7653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934605 is committed 00010000:00010000:3.0:1787580226.138946:0:16629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6b004f7/0xc86deac208338dd7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580226.138961:0:16629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d6b004f7/0xc86deac208338dd7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580226.138985:0:16629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d6b004f7/0xc86deac208338dd7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580226.138992:0:16629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8fae48db8800 already unused, calling callback (ffffffffc155a230) 00010000:00010000:3.0:1787580226.138998:0:16629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6b004f7/0xc86deac208338dd7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580226.139005:0:16629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6b004f7/0xc86deac208338dd7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580226.139026:0:16629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d6b004f7/0xc86deac208338dd7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787580226.139035:0:16629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d6b004f7/0xc86deac208338dd7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787580226.139288:0:16629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7463ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1a27ab63-1899-406a-bdda-fd6b0377149d+5:2360:x1874413239794048:12345-192.168.202.36@tcp:4:dd.0 Request processed in 147651us (458863us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1787580226.139298:0:16629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 7 00010000:00010000:2.0:1787580226.805299:0:15522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787580227.021823:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580227.021866:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580227.021900:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580227.021923:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580227.021939:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580227.021953:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:3.0:1787580227.021994:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.36@tcp (source: 12345-192.168.202.36@tcp) 00000100:00100000:2.0:1787580227.022074:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239794304 00000100:00100000:2.0:1787580227.022085:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239794304 00000100:00100000:2.0:1787580227.022157:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239794688 00000100:00100000:2.0:1787580227.022161:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239794688 00000100:00100000:2.0:1787580227.022188:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 30 00000100:00100000:2.0:1787580227.022200:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74ed3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a27ab63-1899-406a-bdda-fd6b0377149d+20:2358:x1874413239794304:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:2.0:1787580227.022287:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74ed3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a27ab63-1899-406a-bdda-fd6b0377149d+20:2358:x1874413239794304:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 89us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580227.022294:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 30 00000100:00100000:2.0:1787580227.022312:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 31 00000100:00100000:2.0:1787580227.022319:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83858f7d-0f97-4f68-815c-0077941bf864+6:2359:x1874413239794688:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:2.0:1787580227.022345:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83858f7d-0f97-4f68-815c-0077941bf864+6:2359:x1874413239794688:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 27us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580227.022351:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 31 00000100:00100000:2.0:1787580227.022370:0:15078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239794560 00000100:00100000:2.0:1787580227.022374:0:15078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239794560 00000100:00100000:2.0:1787580227.022432:0:15078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239794432 00000100:00100000:2.0:1787580227.022436:0:15078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239794432 00000100:00100000:2.0:1787580227.022446:0:15078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239794944 00000100:00100000:2.0:1787580227.022449:0:15078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239794944 00000100:00100000:2.0:1787580227.022458:0:15078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239794816 00000100:00100000:2.0:1787580227.022461:0:15078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239794816 00000100:00100000:2.0:1787580227.022496:0:15078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 14 00000100:00100000:2.0:1787580227.022502:0:15078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae74ed0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1a27ab63-1899-406a-bdda-fd6b0377149d+5:2358:x1874413239794560:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:2.0:1787580227.022529:0:15078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae74ed0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1a27ab63-1899-406a-bdda-fd6b0377149d+5:2358:x1874413239794560:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 27us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580227.022537:0:15078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 14 00000100:00100000:2.0:1787580227.022548:0:15078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 15 00000100:00100000:2.0:1787580227.022555:0:15078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1a27ab63-1899-406a-bdda-fd6b0377149d+5:2359:x1874413239794432:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:2.0:1787580227.022588:0:15078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1a27ab63-1899-406a-bdda-fd6b0377149d+5:2359:x1874413239794432:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 33us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580227.022595:0:15078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 15 00000100:00100000:2.0:1787580227.022605:0:15078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 16 00000100:00100000:2.0:1787580227.022611:0:15078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae779bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:83858f7d-0f97-4f68-815c-0077941bf864+5:2359:x1874413239794944:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:2.0:1787580227.022631:0:15078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae779bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:83858f7d-0f97-4f68-815c-0077941bf864+5:2359:x1874413239794944:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 20us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580227.022637:0:15078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 16 00000100:00100000:2.0:1787580227.022648:0:15078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 17 00000100:00100000:2.0:1787580227.022655:0:15078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae77aa8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:83858f7d-0f97-4f68-815c-0077941bf864+5:2358:x1874413239794816:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:2.0:1787580227.022677:0:15078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae77aa8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:83858f7d-0f97-4f68-815c-0077941bf864+5:2358:x1874413239794816:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 23us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580227.022683:0:15078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 17 00000100:00100000:0.0:1787580227.023194:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413239794176 00000100:00100000:0.0:1787580227.023201:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413239794176 00000100:00100000:0.0:1787580227.023237:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.36@tcp, seq: 122 00000100:00100000:0.0:1787580227.023245:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7f766850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3458fe6f-27ac-41dd-98c0-57097478e8b1+13:2359:x1874413239794176:12345-192.168.202.36@tcp:400:kworker.0 00000100:00100000:0.0:1787580227.023290:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7f766850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3458fe6f-27ac-41dd-98c0-57097478e8b1+13:2359:x1874413239794176:12345-192.168.202.36@tcp:400:kworker.0 Request processed in 44us (1475us total) trans 0 rc 0/0 00000100:00100000:0.0:1787580227.023307:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.36@tcp, seq: 122 00000100:00080000:3.0:1787580227.024184:0:14391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787580227.024192:0:14391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787580227.024196:0:14391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:0.0:1787580227.757770:0:16669:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:3.0:1787580227.827836:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787580228.598271:0:14427:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787580228.598282:0:14427:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787580228.598320:0:14427:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1787580228.598326:0:14427:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1787580228.735109:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787580228.735137:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae77aa8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874413262844800:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787580228.735213:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787580228.735733:0:15082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262844800 00000100:00100000:3.0:1787580228.735754:0:15082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262844800 00000100:00100000:3.0:1787580228.735813:0:15082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787580228.735822:0:15082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae77aa9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874413262844800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787580228.735857:0:15082:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787580228.735905:0:15082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae77aa9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1874413262844800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1787580228.735913:0:15082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1787580228.735933:0:14391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787580228.735968:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae77aa8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3315:1874413262844800:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787580228.854986:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787580229.237590:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7f35f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874413262845312:0@lo:400:kworker.0 00000100:00100000:2.0:1787580229.237731:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787580229.237826:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787580229.237845:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7f35ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5949e638-96f6-489a-aea1-b9b80ed3224f:3314:1874413262844928:0@lo:400:kworker.0 00000100:00100000:2.0:1787580229.237879:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787580229.237904:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7f35d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874413262845440:0@lo:400:kworker.0 00000100:00100000:2.0:1787580229.237929:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787580229.238083:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7f35f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262845056:0@lo:400:kworker.0 00000100:00100000:2.0:1787580229.238118:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787580229.238144:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787580229.238150:0:3316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae7f35c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874413262845184:0@lo:400:kworker.0 00000100:00100000:2.0:1787580229.238172:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787580229.238209:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262845312 00000100:00100000:2.0:1787580229.238218:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262845312 00000100:00100000:2.0:1787580229.238276:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262845440 00000100:00100000:2.0:1787580229.238280:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262845440 00000100:00100000:2.0:1787580229.238294:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262845184 00000100:00100000:2.0:1787580229.238297:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262845184 00000100:00100000:2.0:1787580229.238311:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787580229.238320:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7f35ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874413262845312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787580229.238378:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7f35ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874413262845312:12345-0@lo:400:kworker.0 Request processed in 58us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580229.238386:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787580229.238486:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787580229.238494:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7f35d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874413262845440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787580229.238523:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7f35d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874413262845440:12345-0@lo:400:kworker.0 Request processed in 31us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580229.238529:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787580229.238541:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787580229.238556:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7f35d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874413262845184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787580229.238597:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7f35d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1874413262845184:12345-0@lo:400:kworker.0 Request processed in 50us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580229.238604:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787580229.238623:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262844928 00000100:00100000:2.0:1787580229.238626:0:14390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262844928 00000100:00100000:2.0:1787580229.238656:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1787580229.238662:0:14390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7f766c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5949e638-96f6-489a-aea1-b9b80ed3224f+19:3314:x1874413262844928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787580229.238692:0:14390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7f766c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5949e638-96f6-489a-aea1-b9b80ed3224f+19:3314:x1874413262844928:12345-0@lo:400:kworker.0 Request processed in 30us (811us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580229.238698:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1787580229.238731:0:15078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262845056 00000100:00100000:2.0:1787580229.238735:0:15078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262845056 00000100:00100000:2.0:1787580229.238765:0:15078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787580229.238772:0:15078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7f35ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262845056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787580229.238805:0:15078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7f35ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1874413262845056:12345-0@lo:400:kworker.0 Request processed in 34us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580229.238811:0:15078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1787580229.238830:0:14391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787580229.238835:0:14391:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787580229.238878:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7f35c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3316:1874413262845184:0@lo:400:kworker.0 00000100:00100000:2.0:1787580229.238889:0:3316:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:2.0:1787580229.238894:0:3316:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8fae74ed3100, transno 8589934595 00000004:00080000:2.0:1787580229.238906:0:3316:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:2.0:1787580229.238929:0:3316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7f35f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3316:1874413262845056:0@lo:400:kworker.0 00000100:00100000:2.0:1787580229.245256:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787580229.245279:0:3317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8fae5ff1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874413262845568:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787580229.245356:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787580229.245682:0:15082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874413262845568 00000100:00100000:2.0:1787580229.245692:0:15082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874413262845568 00000100:00100000:2.0:1787580229.245773:0:15082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787580229.245801:0:15082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8fae7f35f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874413262845568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787580229.245852:0:15082:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 71499776 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1787580229.245903:0:15082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8fae7f35f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1874413262845568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1787580229.245910:0:15082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787580229.245958:0:3317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae5ff1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3317:1874413262845568:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787580229.245987:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7f35ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5949e638-96f6-489a-aea1-b9b80ed3224f:3314:1874413262844928:0@lo:400:kworker.0 00000100:00100000:2.0:1787580229.245999:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7f35d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3314:1874413262845440:0@lo:400:kworker.0 00000100:00100000:2.0:1787580229.246011:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8fae7f35f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3314:1874413262845312:0@lo:400:kworker.0 Debug log: 29794 lines, 29794 kept, 0 dropped, 0 bad.